Vehicle infotainment apparatus using widget and operation method thereof

ABSTRACT

Disclosed are a vehicle infotainment apparatus using a widget and a method of operating the same. According to various embodiments, some UIs of functions on execution in a background can be displayed as a background widget within an area that is always accessible in a screen of the infotainment device, thereby enabling to provide its user with simpler manipulation functions and necessary information.

CROSS REFERENCE TO RELATED APPLICATION

This application claims priority from Republic of Korea PatentApplications No. 10-2020-0047646 filed on Apr. 20, 2020 and No.10-2020-0165735 filed on Dec. 1, 2020, which are hereby incorporated byreference in their entirety.

BACKGROUND Field of the Disclosure

The present disclosure relates to a vehicle infotainment apparatus usinga widget and a method of operation thereof.

Description of the Background

A vehicle infotainment apparatus utilizes a combination of automobiletechnology and IT technology for implementing both the informationfunction and the entertainment function within a vehicle. Recently, thestate of the art vehicle infotainment apparatus has developed to provideits user with not only a media (e.g., music, video, etc.) playbackfunction but also even a platform for utilizing Internet environment orsome application programs. Rapid developments in the technology and usertrends for the vehicle infotainment apparatus lead to increasing needsfor the user convenience for various other sub-tasks in addition torouting guidance under the driving environment. Further, as moredevelopment is made on ADAS (Advanced Driver Assistance System)technology in vehicle navigation systems, more various information isintended to be provided to a driver for his/her more convenient and safedriving.

SUMMARY

An infotainment apparatus according to various embodiments may includeat least one processor implemented to execute computer readableinstructions included in a memory, the at least one processor beingconfigured to, while any one of a navigation function and a plurality ofother functions is being executed in a foreground and at least one otherfunction in addition to the function being executed in the foreground isexecuted in a background, display in a widget form an interfaceassociated with the function being executed in the background on an areathat can be accessed at all times, keeping an active state together withthe foreground execution screen.

An operating method according to various embodiments may include, whileany one of a navigation function and a plurality of other functions isbeing executed in a foreground and at least one other function inaddition to the function being executed in the foreground is executed ina background, displaying in a widget form an interface associated withthe function being executed in the background on an area that can beaccessed at all times, keeping an active state together with theforeground execution screen.

DESCRIPTION OF DRAWINGS

The above and other objects, features, and advantages of the presentdisclosure will be more clearly understood from the following detaileddescription, taken in conjunction with the accompanying drawings, inwhich:

FIG. 1 illustrates an internal configuration of an infotainmentapparatus according to various embodiments;

FIG. 2 illustrates an operating method of an infotainment apparatusaccording to various embodiments;

FIGS. 3 to 17 each illustrate examples of specific UIs in aninfotainment apparatus according to various embodiments;

FIG. 18 illustrates an example of a vehicle equipped with a controlleraccording to various embodiments;

FIG. 19 illustrates a block diagram for a configuration of thecontroller of FIG. 18 ;

FIG. 20 a illustrates an example of a certain environment equipped withan electronic device according to various embodiments;

FIG. 20 b illustrates another example of the environment including anelectronic device according to various embodiments;

FIG. 21 illustrates a simplified block diagram of an electronic deviceaccording to various embodiments;

FIG. 22 illustrates a flowchart for an operating method of an electronicdevice for controlling a screen displayed on a display according tovarious embodiments;

FIG. 23 illustrates examples of a screen displayed on a display of anelectronic device according to various embodiments;

FIG. 24 illustrates an example of switching a screen displayed on adisplay of an electronic device based on a user input for a widgetaccording to various embodiments;

FIG. 25 illustrates an example of switching a screen displayed on adisplay of an electronic device based on another user input for a widgetaccording to various embodiments;

FIG. 26 illustrates a flowchart for an operating method of an electronicdevice for converting a widget displayed on a display into an extendedwidget according to various embodiments;

FIG. 27 illustrates an example of converting a widget of an applicationto an extended widget of the application according to variousembodiments;

FIG. 28 illustrates a flowchart for an operating method of an electronicdevice for converting a widget displayed on a display into a reducedwidget according to various embodiments;

FIG. 29 illustrates an example of converting a widget of an applicationinto a reduced widget of the application according to variousembodiments;

FIG. 30 illustrates a flowchart for an operating method of an electronicdevice for converting an executable object displayed on a display into awidget of an application, according to various embodiments;

FIG. 31 illustrates an example of converting an executable object into awidget of an application according to various embodiments;

FIG. 32 illustrates a flowchart for an operating method of an electronicdevice that provides a service based on a user input for an empty spacein a second partial area, according to various embodiments;

FIG. 33 illustrates an example of displaying an executable object basedon a user input for an empty space in a second partial area andexecuting a function indicated by the executable object, according tovarious embodiments;

FIG. 34 illustrates a flowchart for an operating method of an electronicdevice for converting a third executable object defined in thedescription of FIGS. 32 and 33 into a fourth executable object,according to various embodiments;

FIG. 35 illustrates an example of converting a third executable objectdefined in the description of FIGS. 32 and 33 into a fourth executableobject according to various embodiments;

FIG. 36 illustrates a flowchart for an operating method of an electronicdevice that executes a function of an application providing an executionscreen based on a user input for an empty space in a second partialarea, according to various embodiments;

FIG. 37 illustrates an example of changing a state of an executionscreen displayed within a first partial area based on a user input to anempty space in a second partial area, according to various embodiments;

FIG. 38 illustrates a flowchart for an operating method of an electronicdevice that executes a function of an application providing a widgetbased on a user input for an empty space in a second partial area,according to various embodiments;

FIG. 39 illustrates an example of changing a state of a widget of anapplication displayed in a second partial area based on a user input toan empty space in the second partial area, according to variousembodiments;

FIG. 40 illustrates a flowchart for an operating method of an electronicdevice for displaying a handwriting input field based on a user inputfor an empty space in a second partial area, according to variousembodiments;

FIG. 41 illustrates an example of a handwriting input field displayedaccording to a user input for an empty space in a second partial areaaccording to various embodiments;

FIG. 42 illustrates a flowchart for an operating method of an electronicdevice for processing a drag input initiated from a handwriting inputfield displayed, according to various embodiments;

FIG. 43 illustrates an example of processing a drag input initiated froma handwriting input field and passing a portion of a first partial areabeyond the handwriting input field, according to various embodiments;

FIG. 44 illustrates a flowchart for an operating method of an electronicdevice to display an executable object for guiding a recommendedfunction within a part of a second partial area, according to variousembodiments;

FIG. 45 illustrates an example of an executable object for guiding arecommended function displayed within a part of the second partial areaaccording to various embodiments;

FIG. 46 illustrates a flowchart for an operating method of an electronicdevice to display a plurality of executable objects extending from apart of a second partial area, according to various embodiments;

FIG. 47 illustrates an example of a plurality of executable objectsextending from a part of the second partial area according to variousembodiments;

FIG. 48 illustrates a flowchart for an operating method of an electronicdevice that displays a split screen within a first partial area bydropping a widget of an application displayed within a second partialarea, in the first partial area, according to various embodiments;

FIG. 49 illustrates an example of a split screen in a first partial areadisplayed by dropping a widget of an application displayed within asecond partial area, in the first partial area, according to variousembodiments;

FIG. 50 illustrates a flowchart for an operating method of an electronicdevice that displays a split screen within a first partial area bydropping a plurality of executable objects displayed within a secondpartial area, in the first partial area, according to variousembodiments;

FIG. 51 illustrates an example of a split screen displayed within afirst partial area by dropping a plurality of executable objectsdisplayed within a second partial area, in the first partial area,according to various embodiments;

FIG. 52 illustrates an example of a split screen with an arrangementchanged according to a position in a first partial area dropping aplurality of executable objects displayed within a second partial area,according to various embodiments;

FIG. 53 illustrates a flowchart for an operating method of an electronicdevice to display a split screen within a first partial area by droppinga plurality of executable objects displayed within a second partialarea, in the first partial area including an execution screen of anapplication, according to various embodiments;

FIG. 54 illustrates an example of a split screen displayed within afirst partial area by dropping a plurality of executable objectsdisplayed within a second partial area, in the first partial areaincluding an execution screen of an application, according to variousembodiments;

FIG. 55 illustrates a flowchart for an operating method of an electronicdevice to move a widget or executable object within a second partialarea based on identifying a designated event from a passenger seat,according to various embodiments;

FIG. 56 shows an example of a widget or an executable object within asecond partial area that is moved based on identifying a designatedevent from the passenger seat, according to various embodiments;

FIG. 57 illustrates a flowchart for an operating method of an electronicdevice to extend a second partial area based on a hovering inputaccording to various embodiments;

FIG. 58 illustrates an example of a second partial area that extendsbased on a hovering input according to various embodiments;

FIG. 59 illustrates a flowchart for an operating method of an electronicdevice to extend at least one executable element in an execution screenof an application within a first partial area based on a hovering input,according to various embodiments;

FIG. 60 illustrates an example of at least one executable element in anexecution screen of an application within a first partial area thatextends based on a hovering input according to various embodiments;

FIG. 61 illustrates a flowchart for an operating method of an electronicdevice for displaying a notification message based on a hovering inputaccording to various embodiments;

FIG. 62 illustrates an example of a notification message displayed basedon a hovering input according to various embodiments;

FIG. 63 illustrates a flowchart for an operating method of an electronicdevice for processing a notification related to another application thatis made while displaying an execution screen of an application accordingto various embodiments;

FIG. 64 illustrates an example of a screen that is switched based onprocessing of a notification according to various embodiments;

FIG. 65 illustrates a flowchart for an operating method of an electronicdevice for displaying a split screen based on a user input according tovarious embodiments;

FIG. 66 illustrates an example of a split screen displayed based on auser input according to various embodiments;

FIG. 67 illustrates a flowchart for an operating method of an electronicdevice for switching an execution screen of an application within adisplay area of a display to an execution screen of another applicationwith a reduced execution screen within a display area of anotherdisplay, according to various embodiments;

FIG. 68 illustrates an example of exchanging a screen displayed on adisplay and another screen displayed on another display with each otheraccording to various embodiments;

FIG. 69 illustrates a signal flow of controlling an electronic devicethrough a second other electronic device, among a first other electronicdevice and the second other electronic device included within a vehicle,according to various embodiments;

FIG. 70 illustrates an example of a screen of an electronic devicecontrolled by a second other second electronic device according tovarious embodiments;

FIG. 71 illustrates a flowchart for an operating method of an electronicdevice for controlling a screen displayed on a display based on a userinput received via another display, according to various embodiments;

FIG. 72 illustrates an example of a screen on a display that changes adisplay state, based on a user input received through another displayaccording to various embodiments;

FIG. 73 illustrates a flowchart for an operating method of an electronicdevice for moving at least one executable element on an execution screenof a first application within a first partial area or a widget of asecond application within a second partial area based on a hoveringinput, according to various embodiments;

FIG. 74 illustrates an example of at least one executable element on anexecution screen of a first application within a first partial area or awidget of a second application within a second partial area based on ahovering input, according to various embodiments;

FIG. 75 illustrates a flowchart for an operating method of an electronicdevice for extending at least one executable element on an executionscreen of a first application within a first partial area or a widget ofa second application in a second partial area based on a hovering input,according to various embodiments;

FIG. 76 illustrates an example of at least one executable element in anexecution screen of a first application within a first partial area or awidget of a second application within a second partial area, whichextends according to a hovering input, according to various embodiments;

FIG. 77 illustrates a flowchart for an operating method of an electronicdevice for adaptively controlling event information to be displayed onan execution screen of a first application displayed within a firstpartial area, based on an eye-gaze input, according to variousembodiments;

FIG. 78 illustrates an example of event information on an executionscreen of a first application within a first partial area, adaptivelydisplayed based on an eye-gaze input, according to various embodiments;and

FIG. 79 illustrates a flowchart for an operating method of an electronicdevice for controlling event information to be displayed on an executionscreen of an application within a first partial area, depending onwhether a destination has been initially set, according to variousembodiments.

DETAILED DESCRIPTION

Hereinafter, various embodiments of the present document will bedescribed with reference to the accompanying drawings.

Various embodiments of the present disclosure and terms used therein arenot intended to limit the technology described therein to the specificembodiments as disclosed hereinafter, and should be understood toinclude various changes, equivalents, and/or substitutes of thecorresponding embodiments. In conjunction with the description of thedrawings, like reference numerals may be used for like elements.Singular expressions may include plural expressions unless the contextclearly indicates otherwise. Throughout the present disclosure,expressions such as “A or B”, “at least one of A and/or B”, “A, B or C”or “at least one of A, B and/or C” may include all possible combinationsof those items listed together. Expressions such as “first”, “second”,and so on may modify the corresponding elements regardless of theirorder or importance, and are only used to distinguish one element fromother elements, without limiting the corresponding elements. When any(e.g., first) first is referred to as being “coupled (eitherfunctionally or communicatively)” or “connected” to/with another (e.g.,second) element, the ‘first’ element may be directly connected to the‘second’ element or may be indirectly connected through another element(e.g., a third element).

The term “module” used throughout the disclosure may include a unitconfigured of hardware, software, firmware, or a combination thereof andmay be used interchangeably with terms such as, for example, logic,logic blocks, parts, or circuits. Such a module may include anintegrally configured single component or a minimum unit or its part toperform one or more functions. For example, the module may be configuredas an application-specific integrated circuit (ASIC).

FIG. 1 illustrates an internal configuration of a vehicle infotainmentapparatus according to various embodiments.

As shown in FIG. 1 , the vehicle infotainment apparatus 100 may includea processor 110, a memory 120, a permanent storage 130, a bus 140, aninput/output interface 150 and a network interface 160, as elements forexecuting the operating method according to FIG. 2 .

The processor 110 may include or be part of any device capable ofprocessing a sequence of instructions. The processor 110 may include,for example, a computer processor, a processor in a mobile device orother electronic device, and/or a digital processor. The processor 110may be connected to the memory 120 through the bus 140.

The memory 120 may include a volatile memory, a permanent memory, avirtual memory or other memory/memories for storing information used oroutput by the infotainment apparatus 100. The memory 120 may include,for example, a random access memory (RAM) and/or a dynamic RAM (DRAM).The memory 120 may be used to store arbitrary information such as stateinformation of the infotainment apparatus 100. The memory 120 may beused to store a set of instructions for the infotainment apparatus 100,including instructions for controlling the operation of the infotainmentapparatus, for example. The infotainment apparatus 100 may include oneor more processors 110 as required or circumstance demand.

The bus 140 may include a communication infrastructure that enablesinteraction between various components of the infotainment apparatus100. The bus 140 may carry data between components of the infotainmentapparatus 100, for example, between the processor 110 and the memory120. The bus 140 may include a wireless and/or wired communicationmedium between components of the infotainment apparatus 100 and mayinclude parallel, serial, and/or other topology of arrangements.

The permanent storage 130 may include components such as a memory orother permanent storage device as used by the infotainment apparatus 100to store data for a predetermined extended time duration (e.g., ascompared to the memory 120). The permanent storage 130 may include anon-volatile main memory as used by the processor 110 in theinfotainment apparatus 100. The permanent storage 130 may include, forexample, a flash memory, a hard disk, an optical disk, or any othercomputer-readable medium.

The input/output interface 150 may include interfaces for touch,display, voice command input, keyboard, or other input/output devices.Various inputs related to configuration commands and/or infotainmentoperations may be received through the input/output interface 150.

Network interface 160 may include one or more interfaces to networkssuch as local area network (LAN) or Internet. The network interface 160may include interfaces for wired or wireless connections. Configurationcommands may be received through the network interface 160. Further,information related to the infotainment operation may be received ortransmitted through the network interface 160.

In addition, in another embodiments, the infotainment apparatus 100 mayinclude more components than the components as in FIG. 1 . Here, itshould be noted however, that some or most of those prior art componentsmay be refrained to clearly show. For example, the infotainmentapparatus 100 may be implemented to include at least some of theinput/output devices connected to the input/output interface 150described above, or may further include a transceiver, a GlobalPositioning System (GPS) module, a camera, various sensors, otherelements such as a database.

FIG. 2 illustrates an operating method of an infotainment apparatusaccording to various embodiments.

The processor 110 may perform steps S210 to S250 included in theinfotainment operation method of FIG. 2 . For example, the processor 110may be implemented to execute instructions according to the programcodes of the operating system (OS) included in the memory 120 and atleast one program code, wherein the least one program code maycorrespond to codes of a program implemented to execute the infotainmentoperation method.

The infotainment operation method according to various embodiments maynot occur in the order as illustrated in FIG. 2 , and some of thosesteps may be omitted. Otherwise, an additional process or step may befurther included.

In step S210, the processor 110 may display an execution screen of thenavigation function as an activated screen, when the navigation functionis executed in the foreground state. For example, the vehicleinfotainment apparatus 100 may include a navigation function for routeguidance, an air conditioning control function for controlling a vehicleair conditioner, a hands-free call function, a media playback functionfor playing media contents such as music or video, and so on. Theprocessor 110 may execute the navigation function in the foreground todisplay it on a screen according to a user request.

In step S220, the processor 110 may determine whether it is executingother functions in addition to the navigation function, for example, oneor more of an air conditioning control function, a hands-free callfunction, or a media playback function in the background, in a situationthat the navigation function is running in the foreground.

In step S230, the processor 110 may display, when another function isrunning in the background, an interface related to a function running inthe background, in the form of a widget. The processor 110 may use apredetermined specific area on the screen of the infotainment apparatus100 to display a UI item including at least one UI related to thefunction running in the background, in the form of a widget(hereinafter, referred to as a ‘background widget’). The processor 110may utilize a partial area of the screen of the infotainment apparatus100, for example, any one of a lowermost area, an uppermost area, a leftarea, and a right area as the background widget. As an example, theprocessor 110 may display the background widget on a certain area, whichis accessible at all times maintaining an activated state on the screenof the infotainment apparatus 100, for example, on a taskbar, if suchavailable.

The processor 110 may maintain the execution screen of the navigationfunction in the foreground state, when there is no other functionrunning in the background.

In step S240, the processor 110 may determine whether to enter thescreen of another function from the execution screen of the navigationfunction. In other words, the processor 110 may determine whether afunction running on the foreground is switched from the navigationfunction to the other function.

In step S250, when the processor 110 enters the screen of anotherfunction, that is, when the function running on the foreground isswitched to the other function, it may display the interface related tothe navigation function in the form of a widget, while simultaneouslyswitching the corresponding function to the foreground state andswitching the navigation function to the background state. Likewise, theprocessor 110 may display a UI item including at least one UI related tothe navigation function, on an area that is accessible at all timesmaintaining an activated state on the screen of the infotainmentapparatus 100, for example, on a taskbar.

Accordingly, the processor 110 may provide a set of simple manipulationfunctions and information by means of displaying some UIs of functionsrunning in the background as the background widget in the area that isaccessible at all times within the screen of the infotainment apparatus100.

FIGS. 3 to 6 each illustrate actual exemplary screens of an infotainmentapparatus according to various embodiments.

Referring now to FIG. 3 , it is seen that the screen 300 of theinfotainment apparatus may be configured of an execution screen 310 fora foreground function (hereinafter, referred to as a ‘foregroundexecution screen’), and particularly, inclusive of a taskbar 320 as anexample of a screen area that is accessible at all times whilemaintaining an activated state together with the foreground executionscreen 310.

The processor 110 may configure an icon list 30 (hereinafter, referredto as a ‘favorite list’) of the work functions frequently used by adriver of the vehicle as a quick menu, that is, a short cut icon,arranging the favorite list on the display bar 320. The favorites list30 may include a home button 31 indicating an icon for a function tomove to a home screen, a navigation button 32 indicating an icon for anavigation function, an air conditioning button 33 indicating an iconfor an air conditioning control function, and a call button 34indicating an icon for a hands-free call function icon, a media button35 indicating an icon for a media playback function icon, and the like.

Some of the functions included in the favorites list 30 may beconfigured by default, and icons of other functions other than thedefault functions may be set by means of the driver's selection. Forexample, the home button 31 and the navigation button 32 of thefavorites list 30, may be established by default, while one or more ofthe air conditioning button 33, the call button 34 and the media button35 may be optionally set as task functions frequently used by thedriver.

These icons included in the favorites list 30 may be arranged on basisof a predetermined schedule (e.g., in order of their names or recentexecutions, etc.), and as another example, may be arranged in the orderestablished as a favorite function (in other words, in order added tothe taskbar), the order of recent execution, or the order specifieddirectly by the driver.

Further, the maximum number of the icons included in the favorites list30 may be specified by default, or may be directly set by the driver.

FIG. 3 illustrates a situation in which a certain task function, forexample, a route guidance screen, that is, an execution screen of thenavigation function, is displayed on the foreground execution screen310, and the screen 300 on which there is no function running on thebackground.

FIG. 4 illustrates the screen 300 in case where in a situation that theroute guidance screen, that is, an execution screen of the navigationfunction, is displayed on the foreground execution screen 310, a mediaplayback function is running on the background. Here, a backgroundwidget 400 of the media playback function may be displayed on thetaskbar 320, and then, the background widget 400 may be displayed in aposition adjacent to the media button 35, for example, to the right ofthe media button 35.

FIG. 5 illustrates the screen 300 in case where the navigation functionis being executed in the background while an execution screen of themedia play function, that is, a media playback screen is displayed onthe foreground execution screen 310. A background widget 500 of thenavigation function may be displayed on the taskbar 320, and at thistime, the background widget 500 may be displayed in a position adjacentto the navigation button 32, for example, to the right of the navigationbutton 32. As shown in FIG. 5 , as the background widget 500 of thenavigation function is displayed on the right side of the navigationbutton 32, those icons such as air conditioning button 33, call button34, media button 35, etc., may be automatically shifted as shown in FIG.5 .

Accordingly, it is seen that the background widgets 400 and 500 of anyfunctions running on the background may be displayed at a locationadjacent to the icon of the corresponding function.

Although these background widgets 400 and 500 are shown above as beingdisplayed in a position adjacent to the icon of the function running inthe background, the arrangement as disclosed is not limited thereto andthe positions of the background widgets 400 and 500 may be changed asoccasions demand. For example, referring then to FIG. 6 , the backgroundwidget 600 may be displayed fixed to a predetermined specific position(e.g., either left side or right side) within the taskbar 320.

Furthermore, it is noted that when there is no function running on thebackground, the favorites list 30 may be disposed on the left side ofthe taskbar 320 as shown in FIG. 3 , while when there is any functionrunning on the background, they may be suitably arranged in the order ofthe background widget 600 and the favorites list 30 on the left side ofthe taskbar 320.

In other words, it is noted that the location of the widget is notdetermined according to the function executed in the background, but thebackground widget 600 may be suitably displayed at a fixed position ofthe taskbar 320 regardless of the function executed in the background.

Although the foregoing describes an example that only one function isoperating in the background, the disclosed invention is not limitedthereto. For instance, when there are two or more functions operating inthe background, all the background widgets for each function may bedisplayed altogether on the taskbar 320. In another example, apredetermined number of background widgets may be displayed on thetaskbar 320 according to the priority preset for each function. Forexample, if the priority is preset in the order of an air conditioningcontrol function, a hands-free call function, and a media playbackfunction, then only one background widget may be displayed at one timeaccording to the priority. Further, even when both the hands-free callfunction and the media playback function are running in the background,only the hands-free call function widget may be displayed as desired,while the media playback function widget may be hidden from the screen.When two or more background widgets are displayed at the same time,those background widgets may be displayed in order of the prioritypreset for each function.

The infotainment apparatus according to various embodiments of thedisclosure provides a good user experience that enables the user toeasily and conveniently perform other tasks, by rendering drivinginformation at all times of driving, so as not for the driver to loseone's concentration on driving. In addition, it can provide aninfotainment apparatus that enables the driver to quickly get backconcentration on the driving itself, even if the driver looks away fromthe driving for details of any other tasks, thereby providing moresafety and a more pleasant entertainment experience for the driver.

Hereinafter, a detailed description is made to distinguish between asituation in which other function is being executed in the backgroundwhile a navigation function is already running in the foreground and asituation in which the user is going to enter a screen for anotherfunction during route guidance of the navigation function. Inparticular, when a media playback is being performed, a function tosearch for a media list may be additionally provided, and its detailedentry screen may provide the driver with an intuitive and easy UI forthe list searching during driving.

FIG. 7 illustrates the screen 300 for a situation in which music isbeing played on the background while the route guidance screen of thenavigation function is activated on the foreground execution screen 310.

Referring now to FIG. 7 , it is seen that a widget, that is, abackground widget 700 displaying thereon information and operatingbuttons for executing a media playback function in a simplified form isprovided on the task bar 320 during the route guidance. The backgroundwidget 700 for the media playback function may be displayed at aposition adjacent to the media button 35 in the taskbar 320, forexample, to the right of the media button 35.

As an example, the background widget 700 of the media playback functionmay include a progress bar 701, information of selected music content(e.g., music title, album title, artist name) 702 of the music beingplayed, etc. Further, when the media playback function is of a functioncapable of retrieve song list information, a search button 703 for usein searching a media list may be further included in the backgroundwidget 700.

When the driver selects the search button 703 within the backgroundwidget 700, the processor 110 may provide, in an open or unfolded state,an interface screen 810 (hereinafter, referred to as a ‘list searchscreen’) for searching a media list on the screen 300, as shown in FIG.8 . Here, the list search screen 810 may be displayed at a locationadjacent to the background widget 700, for example, just above thebackground widget 700.

Referring to FIG. 9 , the list search screen 810 may include a playlist90 indicating the currently played music, and further include a scrollbar, by which a music title indicated in the playlist 90 may be searchedby dragging up and down and an adjustment bar 92 capable of adjustingthe size of the list search screen 810. This list search screen 810 maybe applied in a form of which size can be controlled by means of theadjustment bar 92 at the top of the screen.

The list search screen 810 may also be applied in a more functional formthat enables searching for other playlists in addition to the playlist90 inclusive of the currently played music. For example, as shown inFIG. 10 , the left and right search buttons 101 and 102 for searchingthe playlist left and right, or the entire search button 103 forsearching the entire playlist may be further disposed within the listsearch screen 810, where appropriate.

FIG. 11 illustrates a screen 300 for a situation in which the foregroundexecution screen 310 is switched to a media playback screen as it entersanother function, for example, the media playback function, from theroute guidance in operating. It is then possible for the user to enterthe screen 300 of FIG. 11 at once by either selecting the backgroundwidget 700 for the media playback function or selecting the media button35 in the favorites list 30, from the screen 300 of FIGS. 7 and 8 .

Referring to FIG. 11 , when the navigation function is switched to thebackground state, the processor 110 may provide a widget, that is, abackground widget 1100 in which key guide information of the navigationfunction is simply displayed in the taskbar 320. The background widget1100 for the navigation function may be displayed in a position adjacentto the navigation button 32 within the task bar 320, for example, to theright of the navigation button 32. For example, the next directionalinformation and the next-after-next directional information may bedisplayed as route guidance information on the background widget 1100 ofthe navigation function.

The processor 110 may provide a search function in a form of a coverflow UI, as an interface that enable the user to quickly and intuitivelysearch for a favorite song while turning left or right the playlist 1110including the currently played music within the media playback screen,which is the foreground execution screen 310, viewing the song-relatedimage. For each song included in the playlist 1110, an icon configuredof a certain image associated with the song may be displayed accordingto a given alignment criterion.

When entering the media playback screen, the currently playing song maybe focused and displayed in the center as a default of its initialscreen, and a playing gauge of the currently playing song may bedisplayed on the progress bar 1101. A touching onto the progress bar1101 enables a playing position of the song to be moved to a positioncorresponding to the touched point, and a play button 1102 forcontrolling playback and pausing of a selected media content may bedisposed at the center of an icon representing the currently playingsong.

When the cover flow of the playlist 1110 is passed from left to rightbased on the currently playing song, searching for a song may be made asthe item focused in the center is changed to the song indicated in thecorresponding direction, as shown in FIG. 12 . When a song other thanthe currently playing song is focused in the center item as the song issearched for, information on the currently playing song may be minimizedto a predetermined location, for example, in the form of a separate icon1220 at the bottom left position. While searching for a favorite song,information on the currently playing song may be displayed through theicon 1220, and when the icon 1220 is selected, it is possible to providea function of quickly moving the focusing back to the currently playingsong, as illustrated in FIG. 11 . When the currently played song isfocused back on the center position, the icon 1220 may be hidden.

FIG. 13 illustrates a screen 300 for a situation in which a hands-freecall function is executed in the background while the route guidancescreen of the navigation function is activated in the foregroundexecution screen 310. When the driver receives an incoming call with thenavigation function being executed in the foreground, the hands-freecall function is executed in the background as the call is received, andthen, a widget 1300 of the hands-free call function may be displayed onthe taskbar 320. The widget 1300 of the hands-free call function mayinclude a call reception button, a call end button, a calling time,information on a calling party, etc. and some or all of the informationmay be displayed on the taskbar 320 in the form of a toast notification.The widget 1300 of the hands-free call function may be kept so long asthe call is performed, and then disappear from the task bar 320 at thetime of the call being ended.

FIG. 14 shows another screen 300 for a situation in which an airconditioning control function is executed in the background while theroute guidance screen of the navigation function is activated on theforeground execution screen 310. When the driver controls airconditioning, for example, adjusting ventilation speed with thenavigation function being running in the foreground, a widget 1400 forthe air conditioning control function may be displayed on the task bar320 as the air conditioning control function is executed in thebackground. Alternatively, some or all of the corresponding informationmay be displayed on the taskbar 320 in the form of a toast notification.The widget 1400 for the air conditioning control function according tothe driver's air conditioning manipulation may include details of airconditioning operation. The widget 1400 of the air conditioning controlfunction may be kept for a predetermined time from the time when thedriver's manipulation is completed, and then disappear from the task bar320 when the predetermined time duration elapses.

The infotainment UIs according to various embodiments are based on thefollowing research activities. First, the most frequently used tasks bydrivers on driving may be listening to music, which is a media playbackfunction, and it may be followed by an air conditioning control functionand a hands-free call function. Secondly, one of the reasons why adriver manipulates such an electronic device (e.g., smartphone,navigation terminal, etc.) on driving may be most likely browsing themusic favorites list, which ranks high among the drivers' actions, butan investigation reveals that it might be more dangerous behavior tothose drivers than manipulate navigation or send text messages. Thirdly,according to many studies, it is well known that a human brain has afaster reaction speed to perceive images than read texts.

Based on the above rationale, it is possible to display the tasksfrequently used by the driver in the form of a widget that providessimplified information and functions by creating a background widget soas not to interfere with driving, and in particular, provide aninterface that allows quick recognition and reaction within theinfotainment screen for a media search action, which is of an activityto interfere with driving of a vehicle.

The infotainment apparatus according to various embodiments can providefunctions frequently used by the driver including the navigationfunction, as a shortcut icon (quick menu) that can be easily accessed atall times, and implement an interface in the form of the shortcut iconbeing changed to a background widget as the screen changes over. In thecase of the background widget of the media playback function, a playbackprogress bar 701, song information 702, and a search button 703 may beprovided in the form of a widget, and when the search button 703 isselected, the list search screen 810 may be provided on the currentscreen without changing the screen.

The infotainment apparatus according to various embodiments can adopt aformat capable of providing a plurality of notifications at the exacttime when an event occurs, while minimizing visual information relatedto ADAS notifications, thereby ensuring the safety of the driver andtaking all the technical accuracy.

When an ADAS event is detected, the processor 110 may output a visualnotification (visual information) together with a sound notification(audible information) related to the detected event, wherein the visualnotification may include an icon and a text to identify the type of thedetected event.

When a plurality of ADAS events are detected within a predeterminedtime, the processor 110 may output multiple event notifications induplicate, but the latest notification may display both the icon and thetext, while the previous notification may display only the icon.

FIG. 15 shows a screen 300 for a route guidance screen of the navigationfunction displayed on the foreground execution screen 310 when there isno function operating on the background. That is, FIG. 15 illustrates anexemplary screen in case where a forward attention situation is detectedas an example of an ADAS event, when one event has occurred.

Referring now to FIG. 15 , when a forward attention event is detected asone of the ADAS events, the processor 110 may notify the forwardattention event at a predetermined position of the foreground executionscreen 310, for example, at the top of the screen. The forward attentionevent notification 1500 may include an icon 1501 and a text 1502indicating presence of the forward attention event.

When the processor 110 detects another event, for example, a lanedeparture event following the forward attention event, it is possible todisplay the lane departure event notification 1600 together with theprevious event, that is, the forward attention event notification 1500,as shown in FIG. 16 .

When the processor 110 detects another event following the lanedeparture event, for example, a sharp curve event, it may display thesharp curve event notification 1700 together with the previous event,that is, the lane departure event notification 1600 and the forwardattention event notification 1500, as shown in FIG. 17 .

The processor 110 may display the forward attention event notification1500, the lane departure event notification 1600 and the sharp curveevent notification 1700, in an overlapping manner, when the forwardattention event, the lane departure event and the sharp curve event aredetected in succession within a predetermined period of time. On thisoccasion, the latest event notification is displayed on the frontaccording to the order in which ADAS events have been detected, and thepreviously detected event notification is pushed aside in apredetermined direction, for example, to the right side.

The most recent event notification may be displayed on the leftmost andthe most front, and may be displayed as highlighted, for example, thedarkest or brightest colored icon and text, while the previouslydetected event notifications may be only displayed in the form of iconbeing pushed aside to the right side and blurred sequentially. As anexample, the most recent event notification, that is, the sharp curveevent notification 1700 may be displayed with both an icon and a textindicating the sharp curve event, while its preceding eventnotifications, that is, the forward attention event notification 1500and the lane departure event notification 1600 may be only displayedwith their respective icons.

Although it is described that the ADAS event notification is displayedin a fixed position, it is not limited thereto, and the display positionof the ADAS event notification may be changed as appropriate. Forexample, the ADAS event notification may be displayed in a position onthe screen 300 where it does not overlap with route information ordirectional information displayed on the route guidance screen, forexample, in an opposite area substantially not overlapping the left turnroute displayed on the screen 300 during a left-turn route guidance.

The number of ADAS events occurring simultaneously or within a certaintime during driving may be limited to not exceeding a maximum of three,but the number may vary depending on the circumstance, as appropriate.

The infotainment apparatus according to various embodiments can providevisual information together with auditory information for an ADAS event,and thus, displaying a minimized icon as visual information enables thedriver's gaze to be deprived of attention owing to such a small icon, sothat the driver can drive more focusing on the auditory informationwhile keeping the forward attention more. Even if multiple ADAS eventsoccur, all notifications may be displayed on one screen, so that thedriver can accurately recognize which event occurred and remember a typeof the event just by catching a glimpse of the route guidance screen.

The UI of the infotainment apparatus according to various embodimentsmay be used as a UI of navigation software regardless of the hardwaretypes in use.

FIG. 18 illustrates a schematic diagram of a vehicle equipped with acontrol device according to various embodiments, and FIG. 19 illustratesa block diagram of the control device as shown in FIG. 18 .

Referring now to FIGS. 18 and 19 , the control device 2100 according tovarious embodiments, for example, corresponding to the infotainmentapparatus 100 of FIG. 1 , may be mounted onto a vehicle, wherein thevehicle may be an autonomous vehicle 2000.

In this embodiment, the control device 2100 may include a controller2120 having a memory 2122 (e.g., corresponding to the memory 120 and/orthe permanent storage 130 of FIG. 1 ), a processor 2124 (e.g.,corresponding to the processor of FIG. 1 ), a sensor 2110, a wirelesscommunication device 2130 (e.g., corresponding to the network interface160 of FIG. 1 ), a LIDAR 2140, and a camera module 2150.

In this embodiment, the controller 2120 may be configured at the time ofmanufacturing by the manufacturer of the vehicle or may be additionallyconfigured to perform a function of autonomous driving aftermanufacture. Alternatively, a part of the configuration for implementingany additional functions execution may be continuously added to theoriginal one through an upgrade of the controller 2120 originallyconfigured during its manufacturing.

The controller 2120 may transfer a control signal to the sensor 2110, anengine 2006, the user interface 2008, the wireless communication device2130, the LIDAR 2140, and the camera module 2150 that may be included inother components in the vehicle. Further, although not shown, thecontrol signal may be transmitted to an accelerator, a braking system, asteering device, or a navigation apparatus, all of which are related todriving of the vehicle.

In this embodiment, the controller 2120 may control the engine 2006, forexample, in such a manner that the autonomous vehicle 2000 detects aspeed limit of the road on which the vehicle is running and prevents itsdriving speed from exceeding the speed limit or the engine 2006 iscontrolled to accelerate the driving speed of the autonomous vehicle2000 within a range that does not exceed the speed limit. Further, assensing modules 2004 a, 2004 b, 2004 c, and 2004 d additionally detectthe environment outside the vehicle and transmit it to the sensor 2110,the controller 2120 may receive the detected signal and generate acontrol signal to control the engine 2006 or the steering device (notshown) for controlling the driving of the vehicle 2000.

The controller 2120 may control the engine 2006 or the braking system todecelerate the driving speed when there is another vehicle or anyobstacle in front of the vehicle, and control a trajectory, a drivingroute, and a steering angle in addition to the driving speed. Further,the controller 2120 may generate a set of control signals necessary forsafety driving according to information identified of other externalenvironmental elements such as e.g., a driving lane of the vehicle, adriving signal, etc., to generally control driving of the vehicle.

In addition to generating its own control signal, the controller 2120may perform communication with an adjacent vehicle or a central serverto transmit a command for controlling peripheral devices from thereceived information, thereby controlling the driving of the vehicle.

Further, it may be difficult for the controller 2120 to accuratelyrecognize the adjacent vehicle or the lane when the position of thecamera module 2150 or the angle of view is sometimes changed, and thus,the controller 2120 may generate a control signal to control to performa calibration of the camera module 2150 for avoiding such an undesirablesituation. Accordingly, in this embodiment, the controller 2120 maygenerate a calibration control signal to the camera module 2150, so thatthe normal mounted position, direction, and view angle of the cameramodule 2150 can be consistently maintained even if the mounted positionof the camera module 2150 is unexpectedly changed due to e.g.,vibrations or shock generated according to the movement of theautonomous vehicle 2000. When information such as e.g., the initialmounted position, direction, and view angle as stored in advance of thecamera module 2120 gets different, by at least a certain thresholdvalue, from those of the camera module 2120 as measured while theautonomous vehicle 2000 is driving, the controller 2120 may generate thecalibration control signal.

In this embodiment, the controller 2120 may include the memory 2122 andthe processor 2124. The processor 2124 is responsible to executesoftware stored in the memory 2122, according to a set of controlsignals from the controller 2120. More specifically, the controller 2120may store data and instructions for performing the infotainmentoperation methods according to various embodiments in the memory 2122,wherein the instructions may be executed by the processor 2124 toimplement one or more operation methods disclosed herein.

Further, the data and instructions in the memory 2122 may be stored in anon-volatile recording medium executable by the processor 2124. Thememory 2122 may store software and data via one or more internal andexternal devices as appropriate. The memory 2122 may include a randomaccess memory (RAM), read-only memory (ROM), a hard disk, a memory 2122connected to a dongle, or the like.

The memory 2122 may store one or more of an operating system (OS), auser application, and/or executable instructions. The memory 2122 mayfurther store application data and arrangement data structures.

The processor 2124 may be of a microprocessor, or a suitable electronicprocessor such as a controller, a microcontroller or a state machine.

The processor 2124 may be implemented as a combination of computingdevices, and the computing device may be of a digital signal processor,a microprocessor, or a suitable combination thereof.

Furthermore, in the present embodiment, the control device 2100 may beresponsible for monitoring internal and external features of theautonomous vehicle 2000 with at least one sensor 2110 and detecting itsstate.

The sensor 2110 may include at least one sensing module 2004, and thesensing module 2004 may be implemented to be disposed at a specificposition of the autonomous vehicle 2000 depending upon the purpose ofsensing. More specifically, it may be disposed at a lower end, a rearend, a front end, an upper end, or a side end of the autonomous vehicle2000 as occasions demand, and further, may be disposed at any internalparts of the vehicle or in its tires.

Therefore, the sensing module 2004 may detect internal informationrelated to driving of the vehicle such as, e.g., engine 2006, tires,steering angle, speed, weight of the vehicle and so on. Further, the atleast one sensing module 2004 may include an acceleration sensor 2110, agyroscope, an image sensor 2110, a RADAR, an ultrasonic sensor, a LiDARsensor and the like, and may detect motion information of the autonomousvehicle 2000.

The sensing module 2004 may receive as external information specificdata on external environment conditions such as e.g., road conditioninformation, surrounding vehicle information, weather and the like, inthe place where the autonomous vehicle 2000 is located, and may detectvarious vehicle parameters according to the specific data. The detectedinformation may be temporarily or in long-term stored in the memory2122, depending on its purpose of use.

In this embodiment, the sensor 2110 may be adapted to integrate variousinformation from one or more of the sensing modules 2004 for collectingvarious information generated inside and outside the autonomous vehicle2000.

The control device 2100 may further include a wireless communicationdevice 2130.

The wireless communication device 2130 may be further configured toimplement wireless communication between the autonomous vehicles 2000,so that, for example, the autonomous vehicle 2000 can communicate withthe driver's mobile phone, another wireless communication device 2130,another vehicle, a central station (e.g., a traffic control center), aserver, and/or the like. The wireless communication device 2130 may befurther configured to transmit and receive radio signals according to apredetermined wireless communication protocol. The wirelesscommunication protocol may include Wi-Fi, Bluetooth, Long-Term Evolution(LTE), Code Division Multiple Access (CDMA), Wideband Code DivisionMultiple Access (W-CDMA), Global Systems for Mobile Communications(GSM), and the communication protocol is not limited thereto.

Further, in this embodiment, the autonomous vehicle 2000 may beconfigured to implement vehicle-to-vehicle communication through thewireless communication device 2130. That is, the wireless communicationdevice 2130 may communicate with another vehicle and other vehicles onthe road through vehicle-to-vehicle (V2V) communication. The autonomousvehicle 2000 may transmit and receive information such as e.g., awarning on driving, traffic information and the like through V2Vcommunication, and may request information from other vehicles orreceive such a request from other vehicle. For example, the wirelesscommunication device 2130 may perform the V2V communication via adedicated short-range communication (DSRC) device or a Celluar-V2V(C-V2V) device. Further, communication (Vehicle to Everythingcommunication: V2X) between the vehicle and other object (e.g., acertain electronic device carried by pedestrians) in addition tocommunication between those vehicles may be implemented through thewireless communication device 2130.

Further, the control device 2100 may include a LIDAR device 2140. TheLIDAR device 2140 may use data detected through the LIDAR sensor todetect objects around the autonomous vehicle 2000 during its operation.The LIDAR device 2140 may transmit the detected information to thecontroller 2120, so that the controller 2120 can control the autonomousvehicle 2000 according to the detected information. For example, thecontroller 2120 may command the engine 2006 of the vehicle to decreasethe speed, when there is found a vehicle traveling at a lower speedahead of the autonomous vehicle 2000 from the detected information.Further, the vehicle may be commanded to reduce its entering speed to acurved road, depending on the curvature of the curved road.

The control device 2100 may further include a camera module 2150 and thecontroller 2120 may extract object information from an external imagecaptured by the camera module 2150 to cause the controller 2120 toprocess the information.

Further, the control device 2100 may further include imaging devices torecognize the external environment. In addition to the LIDAR 2140, aRADAR, a GPS device, an odometer, and any other computer-vision devicesmay be further used, and one or more of those devices may be selected oroperated either alone or in combination as necessary to enable higherprecision of detection.

The autonomous vehicle 2000 may further include a user interface 2008for inputting of a user to the control device 2100. The user interface2008 may allow the user to input information by means of any appropriateinteraction. For example, it may be implemented as a touch screen, akeypad, menu operation buttons or the like. The user interface 2008 maytransmit the input or instructions to the controller 2120, and thecontroller 2120 may perform a certain vehicle control operation inresponse to the input or instructions.

Further, the user interface 2008 may be adapted to communicate with theautonomous vehicle 2000 via the wireless communication device 2130 witha device disposed outside the vehicle 2000. For example, the userinterface 2008 may be operable in association with a mobile phone of thedriver, a tablet computer, or other computer device.

Moreover, although in this embodiment the autonomous vehicle 2000 hasbeen described as including the engine 2006, it would be also possiblefor the vehicle to have any other types of propulsion systems. Forexample, the vehicle may be driven by electric energy, hydrogen energy,or a hybrid system in combination of these energy sources. Accordingly,the controller 2120 may further include a propulsion mechanism for aspecific propulsion system of the autonomous vehicle 2000, and providecomponents of the propulsion mechanism with control signals therefor.

Hereinafter, referring then to FIG. 18 , a specific configuration of thecontrol device 2100 for performing the infotainment operation methodaccording to various embodiments will be described in more detail.

The control device 2100 may include a processor 2124. The processor 2124may be of a general-purpose single-chip or multi-chip microprocessor, adedicated microprocessor, a microcontroller, a programmable gate array,or the like. The processor may also be referred to as a centralprocessing unit (CPU). Further, in this embodiment, the processor 2124may be formed of multiple processors.

The control device 2100 may further include a memory 2122. The memory2122 may be of any type of electronic component capable of storingelectronic information. The memory 2122 may include a combination of aplurality memories 2122, in addition to a single memory.

Data 2122 b and instructions 2122 a for use in performing theinfotainment operation method according to various embodiments may bestored in the memory 2122. When the processor 2124 executes theinstructions 2122 a, all or part of the instructions 2122 a and the data2122 b required for execution of the instruction may be loaded 2124 aand 2124 b into the processor 2124.

The control device 2100 may further include a transmitter 2130 a, areceiver 2130 b, or a transceiver 2130 c for allowing transmission andreception of signals. One or more antennas 2132 a and 2132 b may beelectrically connected to the transmitter 2130 a, the receiver 2130 b orthe transceiver 2130 c, respectively, and may further include one ormore antennas.

The control device 2100 may further include a digital signal processor(DSP) 2170, through which a digital signal can be quickly processed asrequired in the vehicle.

The control device 2100 may further include a communication interface2180, and the communication interface 2180 may include one or more portsand/or communication modules for connecting other devices to the controldevice 2100. The communication interface 2180 may serve to enable a userand the control device 2100 to interact with each other.

Various components in the control device 2100 may be connected togetherby at least one bus 2190, and the bus 2190 may further include a powerbus, a control signal bus, a status signal bus, a data bus, and thelike. Under control of the processor 2124, those components may mutuallytransmit necessary information to each other through the bus 2190 toperform a desired function.

FIG. 20 a illustrates an example of an environment incorporating anelectronic device according to various embodiments, in which environmentthe autonomous vehicle may include at least one of the vehicleinfotainment apparatus 100 or the control device 2100, as illustratedthrough FIGS. 1 to 19 .

Referring now to FIG. 20 a , the environment 2200 may include anelectronic device 2210 (e.g., the infotainment apparatus 100 or thecontrol device 2100). In various embodiments, the electronic device 2210may be disposed in the environment 2200 to provide various informationto a user within the environment 2200. In various embodiments, theelectronic device 2210 may be a device capable of being temporarilyinstalled in a vehicle but having some degree of mobility. For example,the electronic device 2210 may be any one of a smartphone, a tabletcomputer, a personal computer, and/or a laptop computer that can beconnected by wire or wirelessly through a connector embedded in thevehicle, or a computer program product having a universal serial bus(USB) port. In various embodiments, the electronic device 2210 may be afixed device embedded in the vehicle.

In various embodiments, the electronic device 2210 may be of a devicecapable of providing an in-vehicle infotainment (IVI) service. Invarious embodiments, the electronic device 2210 may be referred to as anIVI device or an IVI system throughout the present document in terms ofproviding such an IVI service. In various embodiments, the electronicdevice 2210 may be referred to as a head unit or a main unit throughoutthis document in terms of being embedded in the vehicle (e.g.,environment 2200). In various embodiments, the electronic device 2210may be configured to control a plurality of components in theenvironment 2200.

In various embodiments, the electronic device 2210 may control anelement related to controlling a wind speed of an air conditioner (orheater) in the environment 2200 or an element related to setting a winddirection of the air conditioner (or heater) in the environment 2200.For example, the electronic device 2210 may change the wind speed orwind direction through the elements based on input data received by theelectronic device 2210.

In various embodiments, the electronic device 2210 may control at leastone display within the environment 2200. For example, the electronicdevice 2210 may control a display screen (or a user interface) for anavigation service through the at least one display. For anotherexample, the electronic device 2210 may display the user interface forplaying contents such as e.g., music, video or the like on the at leastone display.

In various embodiments, the electronic device 2210 may control a devicerelated to a communication function in the environment 2200. Forexample, the electronic device 2210 may send an emergency call or anoutgoing call through the device, or receive an incoming call throughthe device.

In various embodiments, the electronic device 2210 may control an audiodevice related to an audio function within the environment 2200. Forexample, the electronic device 2210 may control to provide music from aloudspeaker.

In various embodiments, the electronic device 2210 may control one ormore sensor devices embedded in the environment 2200. For example, theelectronic device 2210 may control to activate a front camera or a rearcamera according to a driving situation of the vehicle. For anotherexample, the electronic device 2210 may control the operation of aplurality of sensors for an advanced driver assistance system (ADAS).

FIG. 20 b illustrates another example of the environment incorporatingan electronic device according to various embodiments. This environmentmay include at least one of the infotainment apparatus 100 or thecontrol device 2100 as illustrated through FIGS. 1 to 19 .

Referring now to FIG. 20 b , the environment 2250 may include anelectronic device 2210 and another electronic device 2220. In variousembodiments, the electronic device 2210 may correspond to the electronicdevice 2210 defined through the description of FIG. 20 a . In variousembodiments, the electronic device 2220 may be a device connected to theelectronic device 2210 as above described. In various embodiments, theelectronic device 2220 may be of a mobile device, including at least oneof a smartphone, a tablet computer, a personal computer (PC), a laptopcomputer, and a computer program product with a universal serial bus(USB) port.

In various embodiments, the electronic device 2210 may display a screenon at least one display of the electronic device 2210 based on datareceived from the electronic device 2220.

In some embodiments, the data transmitted from the electronic device2220 to the electronic device 2210 may be display data generated by theelectronic device 2220. In an embodiment, the display data may be datafor displaying a screen corresponding to a screen displayed on thedisplay of the electronic device 2220 on the at least one display of theelectronic device 2210. For example, the display data may be data forsupporting mirroring from the electronic device 2220 to the electronicdevice 2210. In another embodiment, the display data may be data fordisplaying a screen distinct from a screen displayed on the display ofthe electronic device 2220 on the at least one display of the electronicdevice 2210. In other words, the display data may be data for supportingcasting from the electronic device 2220 to the electronic device 2210,although it is not limited thereto.

In an embodiment, the electronic device 2220 may obtain information onthe at least one display of the electronic device 2210, such as e.g.,aspect ratio, screen size, etc. of the display, and generate the displaydata based on the obtained information to transmit the generated displaydata to the electronic device 2210. The electronic device 2210 mayreceive the display data from the electronic device 2220, and based onthe received display data, display a screen on the at least one display,without making conversion to suit with the aspect ratio of the at leastone display or the screen size of the at least one display, but it isnot limited thereto.

In another embodiment, the electronic device 2220 may generate thedisplay data without information about the at least one display of theelectronic device 2210 and transmit the display data to the electronicdevice 2210. The electronic device 2210 may convert the received displaydata based on information about the at least one display of theelectronic device 2210, and display a screen on the at least one displaybased on the converted display data, but it is not limited thereto.

In some other embodiments, the data transmitted from the electronicdevice 2220 to the electronic device 2210 may be data for execution of avirtual machine operating in the electronic device 2210. For example,the data may include a status of the memory of the electronic device2220 related to the virtual machine, a status of the processor of theelectronic device 2220 related to the virtual machine, a status of theinput device of the electronic device 2220 related to the virtualmachine, and a status of the display of the electronic device 2220related to the virtual machine, or a combination thereof. In otherwords, the data may be migrated from the electronic device 2220 to theelectronic device 2210. The electronic device 2210 may receive themigrated data and then execute the virtual machine based on the migrateddata to display a screen on the at least one display of the electronicdevice 2210, although it is not limited thereto.

As described in FIGS. 20 a and 20 b , the electronic device 2210 mayindependently provide an intended service within the vehicle (e.g., theenvironment 2200) in no association with any other external electronicdevice(s), and provide such a service within the vehicle (e.g., theenvironment 2250) based on association with such an external electronicdevice (e.g., the electronic device 2220). Accordingly, it should benoted, in this document, that execution of an application (or a program)by the electronic device 2210 or the processor of the electronic device2210 (for example, the processor 2230 of FIG. 21 ) may imply theelectronic device 2210 directly executing the application installed inthe electronic device 2210, as well as the electronic device 2210accessing to the external electronic device to execute the applicationinstalled in the external electronic device, and the electronic device2210 receiving information on the application installed in and executedby the external electronic device.

FIG. 21 illustrates a schematic block diagram of an electronic deviceaccording to various embodiments. This schematic block diagram mayindicate a functional configuration of the electronic device 2210 underthe environment 2200 of FIG. 20 a or the electronic device 2210 in theenvironment 2250 of FIG. 20 b.

Referring now to FIG. 21 , the electronic device 2210 may include aprocessor 2230, a memory 2235, a display 2240, a communication circuit2245, a camera 2247, and/or a sensor 2249.

The processor 2230 may be configured to control an overall operation ofthe electronic device 2210 and may execute a variety of applications toprovide an advertisement service, an Internet service, a game service, amultimedia service, and a navigation service. In various embodiments,the processor 2230 may include a single processor core or multipleprocessor cores. For example, the processor 2230 may include amulti-core such as e.g., a dual-core, a quad-core, a hexa-core and thelike. According to various embodiments, the processor 2230 may furtherinclude a cache memory disposed inside or outside of it.

The processor 2230 may receive instructions from other components of theelectronic device 2210, analyze the received instructions, and performarithmetic operations or process data according to the analyzedinstructions.

The processor 2230 may process data or signals generated or output by anapplication. For example, the processor 2230 may request instructions,data, or signals from the memory 2235 to execute or control theapplication. The processor 2230 may write (or store) or update theinstructions, data, or signals to the memory 2235 to execute or controlthe application.

The processor 2230 may analyze messages, data, instructions or signalsreceived from the memory 2235, the display 2240, the communicationcircuit 2245, the camera 2247, and/or the sensor 2249, to process them.Further, the processor 2230 may generate new messages, data,instructions, or signals based on the received messages, data,instructions or signals. The processor 2230 may provide the processed orgenerated messages, data, instructions or signals to the memory 2235,the display 2240, the communication circuit 2245, the camera 2247 or thesensor 2249.

All or part of the processor 2230 may be electrically or operablycoupled with or connected to any other component(s) within theelectronic device 2210, such as e.g., the memory 2235, the display 2240,the communication circuit 2245, the camera 2247, the sensor 2249 and/orthe like.

According to various embodiments, the processor 2230 may configured withone or more processors. For example, the processor 2230 may include anapplication processor (AP) for controlling a higher layer of programsuch as e.g., an application program, a graphics processing unit (GPU)for configuring a screen displayed on the display 2240 and controllingthe screen, an image signal processor for controlling the camera 2247, asensor hub for controlling the sensor 2249, a communication processor(CP) to perform communication control, and so on.

The memory 2235 may store instructions for controlling the electronicdevice 2210, control instruction codes, control data, or user data. Forexample, the memory 2235 may include at least one application, anoperating system (OS), a middleware, and/or a device driver.

The memory 2235 may include one or more of a volatile memory or anon-volatile memory. The volatile memory may include a dynamic randomaccess memory (DRAM), a static RAM (SRAM), a synchronous DRAM (SDRAM),phase-change RAM (PRAM), magnetic RAM (MRAM), resistive RAM (RRAM),ferroelectric RAM (FeRAM), and so on. The nonvolatile memory may includea read-only memory (ROM), a programmable ROM (PROM), an electricallyprogrammable ROM (EPROM), an electrically erasable programmable ROM(EEPROM), a flash memory, or the like.

The memory 2235 may include a non-volatile medium such as e.g., a harddisk drive (HDD), a solid-state disk (SSD), an embedded multimedia card(eMMC), a universal flash storage (UFS), and so on.

The display 2240 may output contents, data, or signals. In variousembodiments, the display 2240 may display a set of image signalsprocessed by the processor 2230. For example, the display 2240 maydisplay a captured or still image. For another example, the display 2240may display a moving picture or a camera preview image. As anotherexample, the display 2240 may display a graphical user interface (GUI)so that a user may interact with the electronic device 2210.

The display 2240 may be configured with a liquid crystal display (LCD)or an organic light emitting diode (OLED) as circumstances demand.

According to various embodiments, the display 2240 may be configuredwith an integral touch screen, being coupled with a sensor capable ofreceiving a touch input or the like.

The communication circuit 2245 may be used to establish a communicationpath between the electronic device 2210 and another electronic devicesuch as, for example, an external electronic device (e.g., an electronicdevice 2220) or any electronic device embedded in a vehicle. Thecommunication circuit 2245 may support specific protocols capable ofconnecting to the other electronic device by wire or wirelessly. Forexample, the communication circuit 2245 may include a module (orcircuit) for at least one of Bluetooth communication technique,Bluetooth low energy (BLE) communication technique, wireless fidelity(Wi-Fi) communication technique, cellular (or mobile) communicationtechnique, or wired communication technique. For another example, thecommunication circuit 2245 may include HDMI, USB interface, SD cardinterface, or audio interface operating in association with a connectingterminal such as a high definition multimedia interface (HDMI)connector, a universal serial bus (USB) connector, an SD card connector,or an audio connector (e.g., a headphone connector).

The communication circuit 2245 may transfer information or data receivedthrough the communication path from the other electronic device, to theprocessor 2230. The communication circuit 2245 may transmit theinformation or data received from the processor 2230 to the otherelectronic device via the communication path.

The camera 2247 may capture a still image or a moving image. In variousembodiments, the camera 2247 may include at least one or more lenses(e.g., a lens assembly), an image sensor, a flash, an image stabilizer,or a buffer memory. For example, the one or more lenses may collectlight emitted from a subject for capturing an image.

According to various embodiments, the camera 2247 may include aplurality of lens assemblies. For example, the plurality of lensassemblies may have the same lens properties (e.g., angle of view, focallength, autofocus, f-number, or optical zoom). For example, at least oneof the plurality of lens assemblies may have a lens property that isdistinct from another at least one of the plurality of lens assemblies.For example, at least one of the plurality of lens assemblies may beconfigured for a wide-angle lens, while the other at least one of theplurality of lens assemblies may be configured for a telephoto lens.

In various embodiments, the flash may emit a light source used toenhance light emitted from a subject. For example, the flash may includeone or more light emitting diodes (e.g., a red-green-blue (RGB) LED, awhite LED, an infrared (IR) LED or an ultraviolet (UV) LED), or a xenonlamp.

In various embodiments, the image sensor may convert light transmittedfrom the subject through the one or more lenses into an electricalsignal, so as to obtain an image corresponding to the subject (e.g.,image related to the vehicle including the electronic device 2210). Inone embodiment, the image sensor may include an image sensor selectedfrom image sensors with different attributes, such as e.g., an RGBsensor, a black and white (BW) sensor, an IR sensor, or a UV sensor; aplurality of image sensors with the same attribute; or a plurality ofimage sensors having different properties. Each image sensor included inthe image sensors may be implemented with, e.g., a charge coupled device(CCD) sensor or a complementary metal oxide semiconductor (CMOS) sensor.

In various embodiments, the image stabilizer may move or control the oneor more lens or the image sensor in a specific direction (for example,its read-out timing can be adjusted), in order to at least partiallycompensate for any negative effect (e.g., image shaking) caused by themovement on the captured image, in response to the movement of thecamera 2247 or the electronic device 2210. In one embodiment, the imagestabilizer may be implemented with an optical image stabilizer, whereina gyro sensor (e.g., sensor 2249) or an acceleration sensor (e.g.,sensor 2249) disposed inside or outside of the electronic device 2210 orthe camera 2247 can be used to detect its movement.

In various embodiments, the buffer memory may at least temporarily storeat least part of the image acquired through the image sensor, for asubsequent image processing operation. For example, when a delay inacquisition of an image due to a shutter or a high-speed acquisition ofa multiplicity of images is executed, the acquired original image (e.g.,image of high resolution) may be stored in the buffer memory and aduplicate image (e.g., image of low resolution) corresponding to theoriginal image may be previewed on the display 2240. When a specifiedcondition is satisfied (e.g., for a user input or a system command)following the preview, at least part of the original image stored in thebuffer memory may be acquired and processed by the image signalprocessor. In an embodiment, the buffer memory may be configured with atleast a part of the memory 2235 or a separate memory that isindependently operated from the memory 2235.

The sensor 2249 may generate an electrical signal or data valuecorresponding to an operating condition (e.g., power or temperature) ofthe inside of the electronic device 2210, or an external environmentalcondition of the electronic device 2210 (e.g., under the environment2200 or the environment 2250). For example, the sensor 2249 may includea gesture sensor, a gyro sensor, an atmospheric pressure sensor, amagnetic sensor, an acceleration sensor, a grip sensor, a proximitysensor, a color sensor, an IR (infrared) sensor, a biometric sensor, atemperature sensor, a humidity sensor, or an illuminance sensor.

In various embodiments, at least one of the communication circuit 2245,the camera 2247 or the sensor 2249 may be disposed outside theelectronic device 2210. For example, at least one of the communicationcircuit 2245, the camera 2247 or the sensor 2249 may be a componentdisposed within the environment 2210 rather than a component in theelectronic device 2210, but it is not limited thereto.

In various embodiments, the processor 2230, while executing a firstapplication and a second application, may display an execution screen ofthe first application within a first partial area and display a widgetof the second application including a first executable element and asecond executable element, and a first executable object to indicate thefirst application, within a second partial area, the first partial areaand the second partial area adjacent to the first partial area forming adisplay area of the display; based on receiving a first user input forthe first executable element of the widget of the second application,while displaying the execution screen of the first application withinthe first partial area and displaying the widget of the secondapplication and the first executable object within the second partialarea, display an execution screen of the second application switchedfrom the execution screen of the first application within the firstpartial area and display within the second partial area a widget of thefirst application switched from the first executable object and thesecond executable element to indicate the second application, beingswitched from the widget of the second application; and based onreceiving a second user input for the second executable element of thewidget of the second application, while displaying the execution screenof the first application within the first partial area and displayingthe widget of the second application and the first executable objectwithin the second partial area, display at least one visual itemavailable through the second executable element within an area extendingfrom the widget of the second application, in an overlapping manner, onthe execution screen of the first application displayed within the firstpartial area.

In various embodiments, the processor 2230 may be configured to displaythe execution screen of the first application within the first partialarea and display the widget of the second application and the firstexecutable object within the second partial area, with no user inputbeing received, while executing the first application and the secondapplication.

In various embodiments, the first user input may be a single tap inputfor the first executable element, and the second user input may be asingle tap input for the second executable element, the processor 2230:

based on receiving a third user input dragging the widget of the secondapplication in a first direction, while displaying the execution screenof the first application within the first partial area and displayingthe widget of the second application and the first executable objectwithin the second partial area, may display an extended widget of thesecond application switched from the widget of the second applicationwithin the second partial area; and

based on receiving a fourth user input dragging the widget of the firstapplication in the first direction, while displaying the executionscreen of the second application within the first partial area anddisplaying the widget of the first application and the second executableobject within the second partial area, may display an extended widget ofthe first application switched from the widget of the first applicationwithin the second partial area;

wherein the display position of the first executable object may be movedin the first direction according to switching from the widget of thesecond application to the extended widget of the second application,when the widget of the second application is switched to the extendedwidget of the second application through the third user input, while thedirection from the widget of the second application to the firstexecutable object is the first direction, and

the display position of the first executable object may be maintainedindependently of switching from the widget of the second application tothe extended widget of the second application, when the widget of thesecond application is switched to the extended widget of the secondapplication through the third user input, while the direction from thewidget of the second application to the first executable object is asecond direction opposite to the first direction;

wherein the display position of the second executable object may bemoved in the first direction according to switching from the widget ofthe first application to the extended widget of the first application,when the widget of the first application is switched to the extendedwidget of the first application through the fourth user input, while thedirection from the widget of the first application to the secondexecutable object is the first direction, and

the display position of the second executable object may be maintainedindependently of switching from the widget of the first application tothe extended widget of the first application, when the widget of thefirst application is switched to the extended widget of the firstapplication through the fourth user input, while the direction from thewidget of the first application to the second executable object is thesecond direction.

In some embodiments, the processor 2230 may be configured to:

display a reduced widget of the second application switched from thewidget of the second application within the second partial area, basedon receiving a fifth user input dragging the widget of the secondapplication in the first direction, while displaying the executionscreen of the first application within the first partial area anddisplaying the widget of the second application and the first executableobject within the second partial area; and

display a reduced widget of the first application switched from thewidget of the first application within the second partial area, based onreceiving a sixth user input dragging the widget of the firstapplication in the second direction, while displaying the executionscreen of the second application within the first partial area anddisplaying the widget of the first application and the second executableobject within the second partial area;

wherein the display position of the first executable object may be movedin the second direction according to switching from the widget of thesecond application to the reduced widget of the second application, whenthe widget of the second application is switched to the reduced widgetof the second application through the fifth user input, in a state thatthe direction from the widget of the second application to the firstexecutable object is the first direction, and the display position ofthe first executable object may be maintained independently of switchingfrom the widget of the second application to the reduced widget of thesecond application, when the widget of the second application isswitched to the reduced widget of the second application through thefifth user input, in a state that the direction from the widget of thesecond application to the first executable object is the seconddirection;

wherein the display position of the second executable object may bemoved in the second direction according to switching from the widget ofthe first application to the reduced widget of the first application,when the widget of the first application is switched to the reducedwidget of the first application through the sixth user input, in a statethat the direction from the widget of the first application to thesecond executable object is the first direction, and the displayposition of the second executable object may be maintained independentlyof switching from the widget of the first application to the reducedwidget of the first application, when the widget of the firstapplication is switched to the reduced widget of the first applicationthrough the sixth user input, in a state that the direction from thewidget of the first application to the second executable object is thesecond direction.

In various embodiments, the widget of the second application and thefirst executable object may be displayed in the second partial areatogether with a third executable object to indicate a third application,and the processor 2230 may be configured to maintain displaying of theexecution screen of the first application within the first partial area,execute the third application, and display a widget of the thirdapplication switched from the third executable object together with thewidget of the second application and the first executable object withinthe second partial area, based on receiving a third user input draggingthe third executable object in the first direction, while displaying theexecution screen of the first application within the first partial areaand displaying the widget of the second application and the firstexecutable object together with the third executable object within thesecond partial area.

In various embodiments, the processor 2230 may be configured to displaya third executable object to indicate a function distinct from thefunctions available through the first application and the secondapplication within the second partial area together with the widget ofthe second application and the first executable object, based onreceiving a third user input for another area within the second partialarea distinct from the display area of the widget of the secondapplication and the display area of the first executable object, andexecute the function indicated by the third executable object, based onreceiving a fourth user input for the third executable object.

In some embodiments, the processor 2230 may be configured to switch theexecution screen of the first application displayed within the firstpartial area to the execution screen of the function, in response toexecution of the function indicated by the third executable object.

In some embodiments, the processor 2230 may be configured to switch thethird executable object displayed within the second partial area to awidget for indicating the execution state of the function, in responseto execution of the function indicated by the third executable object.

In some embodiments, the function may be a function that has been mostrecently provided through the electronic device, among a plurality offunctions that are available with the electronic device anddistinguished from the functions available through the first applicationand the second application.

In some other embodiments, the function may be a function that has beenmost frequently provided through the electronic device, among aplurality of functions that are available with the electronic device anddistinguished from the functions available through the first applicationand the second application.

In some embodiments, the processor 2230 may be configured to switch thethird executable object to a fourth executable object to indicateanother function distinct from the functions available through the firstapplication and the second application, based on receiving a fifth userinput for the third executable object, and execute the other functionindicated by the fourth executable object, based on receiving a sixthuser input for the fourth executable object, wherein the fourth userinput may be a single tap input to the third executable object, and thefifth user input may be an input to drag the third executable object ina designated direction.

In some embodiments, the processor 2230 may be configured to execute thefunction of the first application indicated by a fifth user input, basedon receiving the fifth user input for the other area within the secondpartial area distinguished from the display area of the widget of thesecond application and the display area of the first executable object,and change the state of the execution screen of the first applicationdisplayed within the first partial area, based on the execution of thefunction of the first application, wherein the attribute of the fifthuser input may be distinguished from the attribute of the third userinput.

In some embodiments, the processor 2230 may be configured to execute thefunction of the second application indicated by a fifth user input,based on receiving the fifth user input for the other area within thesecond partial area distinct from the display area of the widget of thesecond application and the display area of the first executable object,and change the state of the widget of the second application displayedwithin the second partial area, based on the execution of the functionof the second application.

In some embodiments, the processor 2230 may be configured to display ahandwriting input field in an overlapping manner on the execution screenof the first application displayed in the first partial area, based onreceiving a fifth user input for the other area within the secondpartial area distinguished from the display area of the widget of thesecond application and the display area of the first executable object,and recognize a character indicated by a path of at least one draginput, based on receiving the at least one drag input initiated from thehandwriting input field, wherein the attribute of the fifth user inputmay be distinct from the attribute of the third user input.

In an embodiment, the handwriting input field may be extended from atleast a part of the other area within the second partial area, and apart of the execution screen of the first application disposedunderneath the handwriting input field may be translucent for itsvisibility.

In one embodiment, the processor 2230 may be configured to display,based on the fifth user input, a plurality of executable objects, forrespectively indicating each of a plurality of applications includingthe first application and the second application, which are displayed inan overlapping manner on the execution screen of the first applicationdisplayed in the first partial area, together with the handwriting inputfield; recognize the character indicated by the path of the at least onedrag input, based on receiving the at least one drag input initiatedfrom the handwriting input field after receiving a sixth user input forthe sixth user input to select an executable object among the pluralityof executable objects; and execute an application indicated by theexecutable object selected by the sixth user input and a functioncorresponding to the recognized character.

In one embodiment, the processor 2230 may be configured to recognize thepath of the at least one drag input passing by a part of the executionscreen of the first application beyond the handwriting input field, as apart of the character instead of the user input for the firstapplication, while the at least one drag input initiated from thehandwriting input field is received. For example, the processor 2230 maybe configured to display a part of the path of the at least one draginput on the execution screen of the first application displayed withinthe first partial area.

In various embodiments, the processor 2230 may be configured to:

display a third executable object for guiding a recommended functionwithin another area of the second partial area distinguished from thedisplay area of the widget of the second application and the displayarea of the first executable object, while displaying the executionscreen of the first application within the first partial area anddisplaying the widget of the second application and the first executionwithin the second partial area; and

execute the recommended function, based on receiving a third user inputfor the third executable object, while displaying the execution screenof the first application within the first partial area and displayingthe third executable object together with the widget of the secondapplication and the first executable object within the second partialarea;

wherein the recommended function may be identified from a model that isrelated to the electronic device and configured to predict a futureexecution pattern of the electronic device, based on past executionheuristics including a past execution history of the electronic device.

In some embodiments, the processor 2230 may be configured to display afourth executable object for guiding another recommended functiondistinct from the aforementioned recommended function, based onreceiving the fourth user input for the third executable object, whiledisplaying the execution screen of the first application within thefirst partial area and displaying the third executable object togetherwith the widget of the second application and the first execution withinthe second partial area; and execute the other recommended function,based on receiving a fifth third user input for the fourth executableobject; wherein the attribute of the fourth user input may be distinctfrom the attribute of the third user input.

In some embodiments, the processor 2230 may be configured to maintaindisplaying of the third executable object, based on receiving a fourthuser input for the third executable object, while displaying theexecution screen of the first application in the first partial area anddisplaying the third executable object together with the widget of thesecond application and the first executable object within the secondpartial area; display a plurality of executable objects for respectivelyguiding a plurality of other recommended functions distinct from theaforementioned recommended function, within an area extended from thethird executable object, in an overlapping manner on the executionscreen of the first application displayed within the first partial area;and execute a recommended function guided by the executable objectselected by the fifth user input, based on receiving a fifth user inputfor selecting the third executable object and an executable object ofthe plurality of executable objects; wherein the attribute of the fourthuser input may be distinct from the attribute of the third user input.

In various embodiments, the processor 2230 may be configured to displaya reduced execution screen of the first application and a reducedexecution screen of the second application within the first partial areaand display the first executable object and the second executable objectswitched from the widget of the second application within the secondpartial area, based on receiving the third user input dropped at thefirst partial area after dragging the widget of the second application,while displaying the execution screen of the first application withinthe first partial area and displaying the widget of the secondapplication and the first executable object within the second partialarea; wherein the attribute of the third user input may be distinct fromthe attribute of the second user input.

In some embodiments, the arrangement of the reduced execution screen ofthe first application and the reduced execution screen of the secondapplication displayed within the first partial area may be determinedbased on the position of the widget of the second application dropped bythe third user input.

In various embodiments, the processor 2230 may be configured to receivethe third user input dropped at the first partial area after draggingboth the first executable object and the second executable object, whiledisplaying the first executable object and the second executable withinthe second partial area without displaying any execution screen withinthe first partial area; execute the first application and the secondapplication, based on receiving the third user input; and display thereduced execution screen of the first application and the reducedexecution screen of the second application within the first partialarea, in response to the execution of the first application and thesecond application; wherein the first executable object and the secondexecutable object displayed within the second partial area may bemaintained independently of the receipt of the third user input.

In some embodiments, the processor 2230 may be configured to:

extend a display area of a reduced execution screen of the firstapplication and reduce a display area of a reduced execution screen ofthe second application, based on receiving the fourth user input formoving in a first direction a boundary between the reduced executionscreen of the first application and the reduced execution screen of thesecond application displayed within the first partial area, whiledisplaying the reduced execution screen of the first application and thereduced execution screen of the second application within the firstpartial area, and displaying the first executable object and the secondexecutable object within the second partial area; and

reduce the display area of the reduced execution screen of the firstapplication and extend the display area of the reduced execution screenof the second application, based on receiving the fifth user input formoving, in a second direction opposite to the first direction, theboundary between the reduced execution screen of the first applicationand the reduced execution screen of the second application displayedwithin the first partial area, while displaying the reduced executionscreen of the first application and the reduced execution screen of thesecond application within the first partial area and displaying thefirst executable object and the second executable object within thesecond partial area.

In an embodiment, the arrangement of at least one of a plurality ofvisual objects within the reduced execution screen of the firstapplication may be changed according to the extension of the displayarea of the reduced execution screen of the first application caused bythe fourth user input and according to the reduction of the display areaof the reduced execution screen of the first application caused by thefifth user input, and the arrangement of at least one of a plurality ofvisual objects within the reduced execution screen of the secondapplication may be changed according to the reduction of the displayarea of the reduced execution screen of the second application caused bythe fourth user input and according to the extension of the display areaof the reduced execution screen of the second application caused by thefifth user input.

In some embodiments, the processor 2230 may be configured to:

receive the fourth user input for the reduced execution screen of thefirst application, while displaying the reduced execution screen of thefirst application and the reduced execution screen of the secondapplication within the first partial area;

display the execution screen of the first application switched from thereduced execution screen of the first application and the reducedexecution of the second application within the first partial area, basedon receiving the fourth user input;

display the widget of the second application switched from the firstexecutable object and the second executable object within the secondpartial area;

receive the fifth user input for the reduced execution screen of thesecond application, while displaying the reduced execution screen of thefirst application and the reduced execution screen of the secondapplication within the first partial area;

display the execution screen of the second application switched from thereduced execution screen of the first application and the reducedexecution of the second application within the first partial area, basedon receiving the fourth user input; and

display the widget of the first application switched from the firstexecutable object and the second executable object within the secondpartial area.

In some embodiments, the arrangement of the reduced execution screen ofthe first application and the reduced execution screen of the secondapplication within the first partial area of the first application maybe determined based on a dragged path of the third user input.

In various embodiments, the processor 2230 may be configured to:

receive the third user input dropping in the first partial area afterdragging both the first executable object and the second executableobject, while displaying the execution screen of the third applicationin the first partial area and displaying the first executable object,the second executable object, and a third executable object forindicating the third application within the second partial area;

execute the first application and the second application, based onreceiving the third user input;

display within the first partial area the reduced execution screen ofthe first application and the reduced execution screen of the secondapplication switched from the execution screen of the third application,in response to the execution of the first application and the secondapplication; and

display in the first partial area the widget of the third applicationswitched from the first executable object, the second application andthe third executable object.

In some embodiments, the arrangement of the reduced execution screen ofthe first application and the reduced execution screen of the secondapplication, switched from the execution screen of the thirdapplication, in the first partial area, may be determined based on thedragged path of the third user input.

In various embodiments, the processor 2230 may be configured to:

identify an event designated from the passenger seat of the vehicle,while displaying the execution screen of the first application withinthe first partial screen and displaying the widget of the secondapplication and the first executable object within the second partialarea; and

based on the identification, move at least one of the widget of thesecond application and the first executable object within the secondpartial area displayed closer to the driver's seat of the vehicle thanthe passenger seat of the vehicle;

wherein at least one of the moved widget of the second application orthe moved first executable object may be displayed closer to thepassenger seat of the vehicle than the driver's seat of the vehiclewithin the second partial area.

In some embodiments, the processor 2230 may be configured to identifythe designated event by identifying a hovering input or a gesture inputover the display area while identifying that both hands are in contactwith the steering wheel of the vehicle.

In some embodiments, the processor 2230 may be configured to identify atleast one of a change in the weight of the user sitting in the passengerseat of the vehicle or a change in tension of the seat belt worn by theuser sitting in the passenger seat of the vehicle in order to identifythe designated event.

In some embodiments, the processor 2230 may be configured to identifythe designated event by identifying that the position where the user'shand has entered the display area is closer to the passenger seat of thevehicle than to the driver's seat of the vehicle, wherein identifyingthat the position where the user's hand has entered the display area iscloser to the passenger seat of the vehicle than to the driver's seat ofthe vehicle may be executed before contacting the display area by theuser's fingers.

In some embodiments, the processor 2230 may be configured to, based onthe identification, move at least one executable element within theexecution screen of the first application within the first partial areadisplayed closer to the driver's seat of the vehicle than to thepassenger seat of the vehicle, wherein the moved at least executableelement may be displayed within the first partial area, closer to thepassenger seat of the vehicle than to the driver's seat of the vehicle.

In various embodiments, the processor 2230 may be configured to:

identifying a hovering input resulting from a user's hand spaced fromthe second partial area and positioned above the second partial area,while displaying the execution screen of the first application in thefirst partial area and displaying the widget of the second applicationand the first executable object within the second partial area, with thevehicle travelling; and

based on identifying the hovering input, extend the second partial area,extend the widget of the second application and the first executableobject within the second partial area, and extend the first executableelement and the second executable element of the widget of the secondapplication.

In some embodiments, the size of the first partial area may bemaintained independently of the extension of the second partial area,and a part of the extended second partial area may overlap the firstpartial area on which the execution screen of the first application isdisplayed.

In some embodiments, the processor 2230 may be configured to reduce thefirst partial area and reduce the execution screen of the firstapplication within the first partial area, based on identifying thehovering input.

In some embodiments, the second partial area may be extended to adimension corresponding to the speed of the vehicle travelling, based onidentifying the hovering input, each of the widget of the secondapplication and the first executable object may be extended to thedimension corresponding to the speed, based on identifying the hoveringinput, and each of the first executable element and the secondexecutable element may be extended to the dimension corresponding to thespeed, based on identifying the hovering input.

In various embodiments, the processor 2230 may be configured to:

identify the hovering input resulting from a user's hand spaced from thefirst partial area and positioned above the first partial area, whiledisplaying the execution screen of the first application in the firstpartial area and displaying the widget of the second application and thefirst executable object within the second partial area, with the vehicletravelling; and

based on identifying the hovering input, extend at least one executableelement within the execution screen of the first application displayedin the first partial area.

In various embodiments, the processor 2230 may be configured to:

identify the hovering input resulting from a user's hand spaced from thedisplay area and positioned above the display area, while displaying theexecution screen of the first application in the first partial area anddisplaying the widget of the second application and the first executableobject within the second partial area, with the vehicle travelling;

based on identifying the hovering input when the speed of the vehicletravelling is greater than or equal to a predetermined speed, display anotification message for informing that the control of the executionscreen of the first application and the widget of the second applicationthrough the user input is restricted, in an overlapping manner on theexecution screen of the first application; and

stop displaying the notification message, based on identifying that aspecified time has elapsed from the timing point of displaying thenotification message.

In various embodiments, the processor 2230 may be configured to:

display the execution screen of the first application within the firstpartial area and display the first executable object and the secondexecutable object within the second partial area, while executing thefirst application among the first application and the secondapplication;

receive a signal distinct from functions supported by the firstapplication and related to functions supported by the secondapplication, through at least one communication circuit of theelectronic device, while displaying the execution screen of the firstapplication within the first partial area and displaying the firstexecutable object and the second executable object within the secondpartial area;

based on receiving the signal, execute the second application, anddisplay the notification of the received signal, in an overlappingmanner, on the execution screen of the first application displayedwithin the first partial area, using the executed second application;and

based on identifying that the first application is a designatedapplication, stop displaying the notification message in response toreceiving a user input for the notification, maintain displaying theexecution screen of the first application within the first partial area,and display the widget of the second application switched from the firstexecutable object and the second executable object within the secondpartial area;

wherein the widget of the second application switched from the secondexecutable object may include information related to the notification.

In some embodiments, the processor 2230 may be configured to, based onidentifying that the first application is not a designated application,stop displaying the notification in response to receiving a user inputfor the notification, switch the execution screen of the firstapplication displayed within the first partial area to the executionscreen of the second application, and switch the first executable objectdisplayed within the second partial area to the widget of the firstapplication, wherein the execution screen of the second application mayinclude information related to the notification.

In various embodiments, the processor 2230 may be configured to:

display the execution screen of the first application within the firstpartial area and display the first executable object and the secondexecutable object within the second partial area, while executing thefirst application among the first application and the secondapplication;

receive a signal distinct from functions supported by the firstapplication and related to functions supported by the secondapplication, through at least one communication circuit of theelectronic device, while displaying the execution screen of the firstapplication within the first partial area and displaying the firstexecutable object and the second executable object within the secondpartial area;

based on receiving the signal, execute the second application;

based on identifying that the first application is a designatedapplication, maintain displaying the execution screen of the firstapplication within the first partial area in response to the executionof the second application, and switch the second executable objectdisplayed within the second partial area to the widget of the secondapplication; and

based on identifying that the first application is not the designatedapplication, switch the execution screen of the first applicationdisplayed within the second partial area to the execution screen of thesecond application in response to the execution of the secondapplication, and switch the first executable object displayed within thesecond partial area to the widget of the first application;

wherein each of the widget of the second application switched from thesecond executable object and the execution screen of the secondapplication switched from the execution screen of the first applicationmay include information related to the signal.

In various embodiments, the processor 2230 may be configured to:

receive a third user input while displaying the execution screen of thefirst application within the first partial area and displaying thewidget of the second application and the first executable object withinthe second partial area;

based on receiving the third user input, switch the execution screen ofthe first application displayed within the first partial area to areduced execution screen of the first application and a reducedexecution screen of the second application, and switch the widget of thesecond application displayed within the second partial area to thesecond executable object;

based on receiving a fourth user input for selecting the reducedexecution screen of the first application of the reduced executionscreen of the first application and the reduced execution screen of thesecond application, being displayed within the first partial area,switch the reduced execution screen of the first application and thereduced execution screen of the second application, displayed within thefirst partial area, to the execution screen of the first application,and switch the second executable object displayed within the secondpartial area to the widget of the second application; and

based on receiving a fifth user input for selecting the reducedexecution screen of the second application of the reduced executionscreen of the first application and the reduced execution screen of thesecond application, being displayed within the first partial area,switch the reduced execution screen of the first application and thereduced execution screen of the second application, displayed within thefirst partial area, to the execution screen of the second application,and switch the first executable object displayed within the secondpartial area to the widget of the first application;

wherein the attribute of the third user input may be distinct from theattribute of each of the first user input and the second user input.

In some embodiments, the third user input may be a hovering input havinga designated pattern caused by the user's hand spaced apart from thedisplay area and positioned over the display area.

In some embodiments, the third user input may be of an eye-gaze inputlooking at the display area for a specified time duration, whiledisplaying the execution screen of the first application within thefirst partial area and displaying the widget of the second applicationand the first executable object within the second partial area, whereinthe eye-gaze input may be identified based on an image acquired with atleast one camera of the electronic device or another electronic devicewithin the vehicle operatively coupled to the electronic device.

In an embodiment, the fourth user input may be an eye-gaze input lookingat the reduced execution screen of the first application of the reducedexecution screen of the first application and the reduced executionscreen of the second application, being displayed within the firstpartial area, for a predetermined time duration, and the fifth userinput may be an eye-gaze input looking at the reduced execution screenof the second application of the reduced execution screen of the firstapplication and the reduced execution screen of the second application,being displayed within the first partial area, for a predetermined timeduration.

In some embodiments, the third user input may be an input to a physicalinput means equipped in a steering wheel in the vehicle, whiledisplaying the execution screen of the first application within thefirst partial area and displaying the widget of the second applicationand the first executable object within the second partial area, whereinthe physical input means may include at least one of a rotatablestructure or a physical button.

In some embodiments, the third user input may be a gesture input havinga designated pattern caused by a user sitting in a driver's seat of thevehicle or a passenger seat of the vehicle, wherein the gesture inputmay be identified based on an image acquired through at least one cameraof the electronic device or another electronic device in the vehicleoperatively coupled with the electronic device.

In various embodiments, the processor 2230 may be configured to:

receive a third user input, while displaying the execution screen of thefirst application in the first partial area, displaying the firstexecutable object and the second executable object within the secondpartial area, and displaying the reduced execution screen of the secondapplication on another display of the electronic device, distinct fromthe electronic device; and

based on receiving the third user input, switch the execution screen ofthe first application displayed within the first partial area to theexecution screen of the second application, and switch the reducedexecution screen of the second application displayed on the otherdisplay to the reduced execution screen of the first application;

wherein the attribute of the third user input may be distinct from theattribute of each of the first user input and the second user input.

In various embodiments, the processor 2230 may be configured to:

establish a connection between the electronic device and a first otherelectronic device positioned within the vehicle, using at least onecommunication circuit of the electronic device;

establish a connection between the electronic device and a second otherelectronic device positioned within the vehicle, using the at least onecommunication circuit;

display the execution screen of the first application within the firstpartial area and display the first executable object and the widget ofthe second application within the second partial area, based on datareceived from the first other electronic device through the connectionbetween the electronic device and the first other electronic device;

based on the data, transmit information on the execution screen of thefirst application displayed within the first partial area andinformation on the widget of the second application displayed within thesecond partial area, to the second other electronic device through theconnection between the electronic device and the second other electronicdevice, while displaying the execution screen of the first applicationwithin the first partial area and displaying the first executable objectand the widget of the second application within the second partial area;

receive information on at least one user input for changing at least oneof the state of the execution screen of the first application displayedwithin the first partial area or the state of the widget of the secondapplication displayed within the second partial area, from the secondother electronic device that received the information on the executionscreen of the first application and the information on the widget of thesecond application, through the connection between the electronic deviceand the second other electronic device;

transfer the information on the at least one user input to the firstother electronic device, through the connection between the first otherelectronic device and the electronic device;

receive another data for at least one of the state of the executionscreen of the first application or the state of the widget of the secondapplication, changed according to the at least one user input, throughthe connection between the first other electronic device and theelectronic device from the first other electronic device; and

based on the other data, display at least one of the changed state ofthe execution screen of the first application or the changed state ofthe widget of the second application.

In some embodiments, the processor 2230 may be configured to:

receive a signal for notifying that at least one of the firstapplication or the second application is controlled by a user of thesecond other electronic device through a connection between the secondother electronic device and the electronic device from the second otherelectronic device, while the second other electronic device receivingthe information on the execution screen of the first application and theinformation on the widget of the second application is receiving atleast one user input; and

based on receiving of the signal, display information for notifying thatat least one of the first application or the second application iscontrolled by the user of the second other electronic device, in anoverlapping manner, on the execution screen of the first applicationdisplayed within the first partial area.

In various embodiments, the processor 2230 may be configured to:

display the execution screen of the first application within a thirdpartial area and display the widget of the second application and thefirst executable object within a fourth partial area, the third partialarea and the fourth partial area forming another display of theelectronic device distinct from the display, the fourth partial areabeing located adjacent to the third partial area on the other display,while displaying the execution screen of the first application withinthe first partial area and displaying the widget of the secondapplication and the first executable within the second partial area;

based on receiving a third user input for the execution screen of thefirst application displayed within the third partial area, execute afunction indicated by the third user input, provide a result ofexecution of the function, and provide a result of execution of thefunction within the execution screen of the first application displayedwithin the third partial area; and

based on receiving a fourth user input for the widget of the secondapplication displayed within the fourth partial area, execute anotherfunction indicated by the fourth user input, provide a result of theexecution of the other function within the widget of the secondapplication displayed within the second partial area, and provide aresult of the execution of the other function within the widget of thesecond application displayed within the fourth partial area.

In various embodiments, the processor 2230 may be configured to:

move at least one executable element within the execution screen of thefirst application to an area receiving a first hovering input, based onidentifying that the first hovering input caused by the user's handspaced from the first partial area and positioned above the firstpartial area is maintained for a specified time duration, whiledisplaying the execution screen of the first application within thefirst partial area and displaying the widget of the second applicationand the first executable object within the second partial area; and

move the widget of the second application to an area receiving a secondhovering input, based on identifying that the second hovering inputcaused by the user's hand spaced from the second partial area andpositioned above the second partial area is maintained for a specifiedtime duration, while displaying the execution screen of the firstapplication within the first partial area and displaying the widget ofthe second application and the first executable object within the secondpartial area.

In various embodiments, the processor 2230 may be configured to:

extend at least one executable element within the execution screen ofthe first application positioned within the area receiving the firsthovering input, based on identifying that the first hovering inputcaused by the user's hand spaced from the first partial area andpositioned above the first partial area is maintained for a specifiedtime duration, while displaying the execution screen of the firstapplication within the first partial area and displaying the widget ofthe second application and the first executable object within the secondpartial area; and

extend the widget of the second application, based on identifying thatthe second hovering input caused by the user's hand spaced from thedisplay area of the widget of the second application and positionedabove the display area of the widget of the second application ismaintained for a specified time duration, while displaying the executionscreen of the first application within the first partial area anddisplaying the widget of the second application and the first executableobject within the second partial area.

In various embodiments, the processor 2230 may be further configured to:monitor whether to receive an eye-gaze input looking at the display areafor a specified time duration, while displaying the execution screen ofthe first application within the first partial area; based on monitoringthat the eye-gaze input is not received, display event informationwithin the execution screen of the first application, using apredetermined timing or time period; and based on monitoring that theeye-gaze input is received, display the event information within theexecution screen of the first application, using another predeterminedtiming or time period distinct from the above predetermined timing ortime period.

In various embodiments, the first application may be an application forproviding a navigation service, and the processor 2230 may be configuredto: receive a user input for setting a destination, while displaying theexecution screen of the first application within the first partial area;identify whether or not the destination set by the user input is adestination initially set in the electronic device; display the eventinformation within the execution screen of the first application using apredetermined timing or time period; based on identifying that thedestination is not a destination initially set in the electronic device;and display the event information within the execution screen of thefirst application using another predetermined timing or time perioddistinct from the above predetermined timing or time period.

FIG. 22 illustrate a flowchart for a method of an electronic device forcontrolling a screen displayed on a display according to variousembodiments. This method may be executed by the infotainment apparatus100, the control device 2100 or the electronic device 2210, or may bealternatively executed by the processor 2230.

FIG. 23 illustrates an example of an exemplary screen displayed on adisplay of the electronic device according to various embodiments.

FIG. 24 illustrates an example of switching a screen displayed on adisplay of the electronic device based on a user input for a widgetaccording to various embodiments.

FIG. 25 illustrates an example of switching a screen displayed on adisplay of the electronic device based on another user input for awidget according to various embodiments.

Referring first to FIG. 22 , in an operation 2255, the processor 2230may execute a first application and a second application. For example,the first application may be an application installed in the electronicdevice 2210. As another example, the first application may be anapplication installed within another electronic device distinct from theelectronic device 2210 (for example, the electronic device 2220 oranother the electronic device 2220 installed in the vehicle,distinguished from the electronic device 2220), although it is notlimited thereto. For example, the second application may be anapplication installed in the electronic device 2210. As another example,the second application may be an application installed in the otherelectronic device distinct from the electronic device 2210, although itis not limited thereto.

In an operation 2257, while executing the first application and thesecond application, the processor 2230 may display the execution screenof the first application within the first partial area and the widget ofthe second application and the first executable object to indicate thefirst application, within the second partial area, the first partialarea the second partial area forming the display area of the display2240, wherein the second partial area is located abutting upon the firstpartial area. For example, the display area of the display 2240 may beformed of only the first and second partial areas. As another example,the display area of the display 2240 may further include another partialarea distinct from the first partial area and the second partial area,although it is not limited thereto.

In various embodiments, the relationship of relative positionrelationship between the first partial area and the second partial areamay be defined in different ways. For example, referring to FIG. 23 , asin the display state 2300, the first partial area 2302 may be defineddirectly above the second partial area 2304. For another example, as inthe display state 2320, the first partial area 2302 may be defineddirectly below the second partial area 2304. For another example, as inthe display state 2340, the first partial area 2302 may be defined onthe right side of the second partial area 2304. As still anotherexample, as in the display state 2360, the first partial area 2302 maybe defined on the left side of the second partial area 2304. However, itis not limited thereto.

In various embodiments, the first partial area may be an area to displayan execution screen of at least one application among a plurality ofapplications being executed by the electronic device 2210. In variousembodiments, the second partial area may be an area to display a widgetor an executable object of at least some of the remaining applicationsexcept for at least one application providing its display screen withinthe first partial area, among a plurality of applications being executedby the electronic device 2210. In various embodiments, the secondpartial area may be an area for displaying at least one executableobject to indicate at least one application not being executed by theelectronic device 2210. For example, the second partial area may be anarea for displaying at least one executable object to indicate at leastone application frequently executed by the electronic device 2210. Theidentification of the at least one application may be executed by theprocessor 2230 without any user input. As another example, the secondpartial area may be an area for displaying at least one executableobject to indicate at least one application identified by a user inputof the electronic device 2210, but it is not limited thereto.

In various embodiments, the processor 2230 may display only theexecution screen of the first application within the first partial area,and display at least one other executable object as well as the firstexecutable object and the widget of the second application within thesecond partial area. For example, referring again to FIG. 23 , as seenin the state 2300, while executing the first application and the secondapplication, the processor 2230 may be configured to display only theexecution screen 2310 of the first application within the first partialarea 2302, and display, within the second partial area 2304, the widget2312 of the second application and the first executable object 2314 toindicate the first application, as well as an executable object 2315(e.g., an object for controlling an air-conditioner in a vehicle), anexecutable object 2316 (e.g., an object for providing a list ofapplications that may be executed in the vehicle), an executable object2317 (e.g., an object for providing a call service), and an executableobject 2318 (e.g., an object for providing a voice input-based service),although not limited thereto.

For example, the first executable object 2314 may be highlighted toindicate that the first application is currently in execution, relativeto the executable object 2315, the executable object 2316, theexecutable object 2317, and the executable object 2318. For example,referring to FIG. 23 , as seen in the state 2300, the first executableobject 2314 may be underlined to indicate that the first application isin its execution state, as distinct from the executable object 2315, theexecutable object 2316, the executable object 2317, and the executableobject 2318, although not limited thereto.

For example, the widget 2312 of the second application may have a sizelarger dimension than the first executable object 2314, the executableobject 2315, the executable object 2316, the executable object 2317, andthe executable object 2318. For example, the widget 2312 of the secondapplication may include information on the service provided from thesecond application currently in execution (e.g., information on acurrently played song when the second application is of a music playbackapplication). For example, the widget 2312 of the second application mayfurther include an element for controlling the second application (e.g.,a second executable element). For example, the widget 2312 of the secondapplication may include a first executable element 2312-1 to display theexecution screen of the second application within the first partial area2302, and a second executable element 2312-2 to control the secondapplication without displaying the execution screen of the secondapplication within the first partial area 2302, although it is notlimited thereto.

In various embodiments, the widget 2312 of the second application mayhave the shape shown in the state 2300 of FIG. 23 , with no user inputbeing received, while displaying the execution screen 2310 of the firstapplication within the first partial area 2302 and displaying the widget2312 of the second application and the first executable object 2314within the second partial area 2304. For example, the widget 2312 of thesecond application may be displayed without a separate user input whiledisplaying the execution screen 2310 of the first application within theentire first partial area 2302 and executing the second application,other than converted from the second executable object 2414 (to befurther described below), based on positioning an input means (e.g., auser's finger) on or above the second executable object 2414 to indicatethe second application, or positioning on or above the second executableobject 2414 a pointer to indicate the position to which the input meanspoints, although it is not limited thereto.

In an operation 2259, the processor 2230 may receive a user input forthe widget of the second application, while displaying the executionscreen of the first application within the first partial area anddisplaying the widget of the second application and the first executableobject within the second partial area. For example, referring again toFIG. 23 , the user input may be a first user input for the firstexecutable element 2312-1 or a second user input for the secondexecutable element 2312-2.

In an operation 2261, the processor 2230 may identify whether thereceived user input is the first user input or the second user input.For example, the processor 2230 may execute operation 2263 when thereceived user input is the first user input, and execute operation 2265when the received user input is the second user input.

In an operation 2263, the processor 2230 may display, based on receivingthe first user input, the execution screen of the second applicationswitched from the execution screen of the first application within thefirst partial area, and display the widget of the first applicationswitched from the first executable object, and the second executableobject switched from the widget of the second application to indicatethe second application within the second partial area. For example,referring then to FIG. 24 , the processor 2230 may switch the state 2300to the state 2401 in response to receiving a first user input 2400 forthe first executable element 2312-1 of the widget 2312 of the secondapplication. For example, in state 2401, the processor 2230 may switchthe execution screen 2310 of the first application displayed in thefirst partial area 2302 to the execution screen 2402 of the secondapplication. For example, in the state 2401, the processor 2230 mayswitch the widget 2312 of the second application displayed in the secondpartial area 2304 into the second executable object 2414. Such a switchfrom the widget 2312 of the second application to the second executableobject 2414 may be executed by the switch from the execution screen 2310of the first application to the execution screen 2402 of the secondapplication. For example, in the state 2401, the processor 2230 mayswitch the first executable object 2314 displayed in the second partialarea 2304 to the widget 2412 of the first application. The switch fromthe first executable object 2314 to the widget 2412 of the firstapplication may be executed by the switch from the execution screen 2310of the first application to the execution screen 2402 of the secondapplication.

In various embodiments, the second executable object 2414 switched fromthe widget 2312 of the second application may be, in the state 2401,highlighted to indicate that the second application is in execution,relative to the executable object 2315, the executable object 2316, theexecutable object 2317, and the executable object 2318. For example, thesecond executable object 2414 may be underlined as distinguished fromthe executable object 2315, the executable object 2316, the executableobject 2317 and the executable object 2318, although it is not limitedthereto.

In various embodiments, the widget 2412 of the first applicationswitched from the first executable object 2314, in a state 2401, mayinclude at least a part of the information provided through theexecution screen 2310 of the first application in the state 2300. Forexample, the widget 2412 of the first application indicates, in thestate 2401, may include information to indicate that the vehicle willhave to go forward 500 m and then turn to the left in order to get tothe destination of the vehicle equipped with the electronic device 2210.

In various embodiments, the widget 2412 of the first application in thestate 2401 may include a first executable element 2412-1. For example,the widget 2412 of the first application in the state 2401 may onlyinclude the first executable element 2412-1, as different from thewidget 2312 of the second application in the state 2300 including aplurality of executable elements (e.g., the first executable element2312-1 and the second executable element 2312-2). For example, the firstexecutable element 2412-1 may be used to display the execution screen2310 of the first application within the first partial area 2302.

In various embodiments, an executable element included in a widget of anapplication displayed within the second partial area 2304 may beconfigured differently according to the attribute of the application.For example, if the application is an application that requiresinteractions between the user and the electronic device 2210 relativelyfrequently, then the widget of the application may further include anexecutable element for displaying an execution screen of the applicationwithin the first partial area 2302 as well as an executable element forcontrolling the application without displaying the execution screen ofthe application. Further, if the application is an application that doesnot require interactions between the user and the electronic device 2210relatively frequently, then the widget of the application may onlyinclude the executable element for displaying the execution screen ofthe application in the first partial area 2302. For another example, ifthe application is an application controlled by a user input with arelatively low complexity, then the widget of the application mayfurther include the executable element for displaying the executionscreen of the application within the first partial area 2302 as well asthe executable element for controlling the application according to theuser input without displaying the execution screen of the application.Further, if the application is an application controlled by a user inputwith a relatively high complexity, then the widget of the applicationmay only include the executable element for displaying the executionscreen of the application in the first partial area 2302. However, it isnot limited to the foregoing.

In an operation 2265, the processor 2230 may display, based on receivingthe second user input, at least one visual item available through thesecond executable element within an area extending from the widget ofthe second application, in an overlapping manner, on the executionscreen of the first application displayed in the first partial area. Forexample, referring then to FIG. 25 , the processor 2230 may switch thestate 2300 to a state 2501 in response to receiving the second userinput 2500 for the second executable element 2312-2 of the widget 2312of the second application in the state 2300. For example, in the state2501, the processor 2230 may keep the execution screen 2310 of the firstapplication displayed within the first partial area 2302 in the state2300 independently of receiving the second user input 2500. For example,in state 2501, the processor 2230 may keep the first executable object2314 displayed within the second partial area 2304 in the state 2300independently of receiving the second user input 2500. For example, inthe state 2501, the processor 2230 may keep the widget 2312 of thesecond application displayed in the second partial area 2304 in thestate 2300 independently of receiving the second user input 2500. Forexample, in the state 2501, the processor 2501 may display an area 2502including the at least one visual item within an area extending from thewidget 2312 of the second application, in an overlapping manner, on theexecution screen 2310 of the first application. For example, the atleast one visual item included in the area 2502 may be used torespectively indicate a plurality of songs including a song (e.g.,“Motion” by Calvin Harris) being played through the second application,although not limited thereto. In various embodiments, the at least onevisual item may be configured to be executable so that the functioncorresponding to the at least one visual item is performed in responseto an input to the at least one visual item.

FIG. 25 illustrates an example in which the area 2502 including the atleast one visual item is extended from the widget 2312 of the secondapplication, but the position of the area 2502 including the at leastone visual item may change. For example, if the priority of informationincluded in the partial area of the execution screen 2310 of the firstapplication disposed underneath the area 2502 extending from the widget2312 of the second application is higher than the priority ofinformation provided through the at least one visual item included inthe area 2502, then the area 2502 may be extended from other area of thesecond partial area 2304 distinguished from the second partial area 2304displaying the widget 2312 of the second application, although it is notlimited thereto.

In various embodiments, the area 2502 may be configured to be formed tobe translucent so that a partial area of the execution screen 2310 ofthe first application disposed underneath the area 2502 can be at leastpartially visible, although it is not limited thereto.

In various embodiments, the area 2502 may be floated on the executionscreen 2310 of the first application so that the area 2502 is movable.For example, the area 2502 may be moved based on a drag input forchanging the display position of the area 2502. When the area 2502 isfloated on the execution screen 2310 of the first application, the area2502 may be changed from an opaque state to a translucent state so thatthe user can visually recognize what information is provided through apart of the execution screen 2310 of the first application arrangedunderneath the area 2502, while the drag input for changing the displayposition of the area 2502 is maintained. However, it is not limitedthereto.

As described above, while displaying the execution screen of the firstapplication in execution, the electronic device 2210 according tovarious embodiments may improve the visibility of the execution screenof the first application by displaying the widget of the secondapplication in execution on another area that does not overlap theexecution screen of the first application. The electronic device 2210according to various embodiments may enhance delivery of information onthe execution state of the second application by displaying the widgetof the second application. The electronic device 2210 according tovarious embodiments may improve the convenience of controlling the firstapplication and the second application operating in the vehicle byperforming switching of the execution screen displayed in the firstpartial area according to an area in which a user input for the widgetof the second application is received, or providing a pop-up window inan overlapping manner on the first partial area.

FIG. 26 illustrates a flowchart for an operating method of theelectronic device for switching a widget displayed on a display into anextended widget, according to various embodiments. This method may beexecuted by the infotainment apparatus 100, the control device 2100 orthe electronic device 2210, or may be executed by the processor 2230.

FIG. 27 illustrates an example of switching a widget of an applicationto an extended widget of the application according to variousembodiments.

Referring now to FIG. 26 , in an operation 2602, the processor 2230 maydisplay the widget of the second application and the first executableobject within the second partial area.

In various embodiments, the arrangement of the widget of the secondapplication and the first executable object displayed within the secondpartial area may be set in various ways. For example, the arrangement ofthe widget of the second application and the first executable object maybe set according to a user input. For another example, the arrangementof the widget of the second application and the first executable objectmay be established according to the frequency of executions of the firstapplication and the frequency of executions of the second application.As another example, the arrangement of the widget of the secondapplication and the first executable object may be established accordingto which one of the first application and the second application hasbeen most recently executed. As another example, the arrangement of thewidget of the second application and the first executable object may beset based on or according to the local time of the area where theelectronic device 2210 is located and/or the use history by the user ofthe electronic device 2210. For another example, the arrangement of thewidget of the second application and the first executable object may beset differently depending on where the electronic device 2210 islocated. However, it is not limited thereto.

For example, the arrangement of the widget of the second application andthe first executable object may be made of a first arrangement in whichthe direction from the widget of the second application to the firstexecutable object is of a first direction, or a second arrangement inwhich the direction from the widget of the second application to thefirst executable object is of a second direction opposite to the firstdirection.

For example, referring then to FIG. 27 , in a state 2700, thearrangement of the widget 2312 of the second application and the firstexecutable object 2314 may be of the first arrangement, of whichdirection from the widget 2312 of the second application to the firstexecutable object 2314 is the first direction.

For another example, referring again to FIG. 27 , in a state 2720, thearrangement of the widget 2312 of the second application and the firstexecutable object 2314 may be of the second arrangement, of whichdirection from the widget 2312 of the second application to the firstexecutable object 2314 is the second direction.

In an operation 2604, the processor 2230 may receive a user input 2702dragging the widget of the second application in the first directionwhile displaying the widget of the second application and the firstexecutable object in the second partial area. For example, referring toFIG. 27 , in the state 2700, the processor 2230 may receive the userinput 2702 dragging the widget 2312 of the second application in thefirst direction, while displaying the widget 2312 of the secondapplication and the first executable object 2314 within the secondpartial area 2304. For example, user input 2702 may be initiated fromthe first executable element 2312-1 and/or may be initiated from thesecond executable element 2312-2. As another example, referring again toFIG. 27 , in the state 2720, the processor 2230 may receive a user input2722 dragging the widget 2312 of the second application in the firstdirection, while displaying the widget 2312 of the second applicationand the first executable object 2314 within the second partial area2304. For example, the user input 2722 may be initiated from the firstexecutable element 2312-1 and/or may be initiated from the secondexecutable element 2312-2.

In an operation 2606, the processor 2230 may switch the widget of thesecond application displayed within the second partial area to anextended widget of the second application, in response to receiving theuser input dragging the widget of the second application displayed inthe second partial area in the first direction. In various embodiments,the amount of information provided through the extended widget of thesecond application may be greater than or equal to the amount ofinformation provided through the widget of the second application. Invarious embodiments, the number of executable elements included in theextended widget of the second application may be greater than or equalto the number of executable elements included in the widget of thesecond application. In various embodiments, the size of each of theexecutable elements included in the extended widget of the secondapplication may be larger than or equal to the size of each of theexecutable elements included in the widget of the second application.However, it is not limited thereto.

For example, referring to FIG. 27 , the processor 2230 may switch thestate 2700 to a state 2710 in response to receiving the user input 2702.In the state 2710, the processor 2230 may display an extended widget2712 of the second application that has been switched from the widget2312 of the second application. The extended widget 2712 of the secondapplication may include a larger number of executable elements than thenumber of executable elements included in the widget 2312 of the secondapplication. For example, the extended widget 2712 of the secondapplication may include an executable element for replaying a musicbeing played through the second application from the beginning or forplaying a previous music of the song being played through the secondapplication, an executable element for pausing the music being playedthrough the second application, and an executable element for playing anext music of the song being played through the second application.

In various embodiments, the length of the extended widget 2712 of thesecond application may be changed according to the length of the dragpath of the user input 2702. For example, when the length of the dragpath of the user input 2702 is of a first length, the length of theextended widget 2712 of the second application may have a third length,and the length of the drag path of the user input 2702 is of a secondlength longer than the first length, the length of the extended widget2712 of the second application may have a fourth length longer than thethird length. The extended widget 2712 of the second application havingthe fourth length may include either a larger amount of information or alarger number of executable elements than the extended widget 2712 ofthe second application having the third length, although it is notlimited thereto.

On the other hand, the first executable object 2314 disposed on theright side of the widget 2312 of the second application may moveaccording to switching from the widget 2312 of the second application tothe extended widget 2712 of the second application. For example, thedistance between the first executable object 2314 and a left edge or aleft periphery of the second partial area 2304 in the state 2700 may beshorter than the distance between the first executable object 2314 andthe left edge of the second partial area 2304 in the state 2710.

As another example, referring again to FIG. 27 , the processor 2230 mayswitch the state 2720 to the state 2730 in response to receiving theuser input 2722. In the state 2720, the display position of the firstexecutable object 2314 disposed on the left side of the widget 2312 ofthe second application may be maintained independently of the switchingfrom the widget 2312 of the second application to the extended widget2712 of the second application. For example, the distance between thefirst executable object 2314 and the left edge of the second partialarea 2304 in the state 2720 may be the same as the distance between thefirst executable object 2314 and the left edge of the second partialarea 2305 in the state 2730.

As described above, the electronic device 2210 according to variousembodiments makes it possible to switch the widget of the application tothe extended widget of the application based on the user input for thewidget of the application in execution, so as to provide an interfacefor controlling the application without the need to switch into theexecution screen of another application displayed within the firstpartial area. Therefore, the electronic device 2210 according to variousembodiments enables its user to enjoy more enhanced user experiencethanks to providing such a convenient interface.

FIG. 28 illustrate a flowchart for a method of the electronic deviceswitching a widget displayed on a display to its reduced widget,according to various embodiments. This method may be executed in theinfotainment apparatus 100, the control device 2100 or the electronicdevice 2210, or may be executed in the processor 2230.

FIG. 29 illustrates an example of switching a widget of an applicationto a reduced widget of the application according to various embodiments.

Referring first to FIG. 28 , in an operation 2802, the processor 2230may display the widget of the second application and the firstexecutable object within the second partial area.

In various embodiments, the arrangement of the widget of the secondapplication and the first executable object displayed in the secondpartial area may be set in various ways. For example, the arrangement ofthe widget of the second application and the first executable object maybe determined by various methods as defined through the description ofFIG. 26 .

For example, the arrangement of the widget of the second application andthe first executable object may be made of a first arrangement in whichthe direction from the widget of the second application to the firstexecutable object is of a first direction, or a second arrangement inwhich a direction from the widget of the second application to the firstexecutable object is of a second direction opposite to the firstdirection.

For example, referring then to FIG. 29 , as in a state 2700, thearrangement of the widget 2312 of the second application and the firstexecutable object 2314 may be the first arrangement, of which directionfrom the widget 2312 of the second application to the first executableobject 2314 is the first direction.

For another example, referring to FIG. 29 , as in a state 2720, thearrangement of the widget 2312 of the second application and the firstexecutable object 2314 may be the second arrangement, of which directionfrom the widget 2312 of the second application to the first executableobject 2314 is the second direction.

In an operation 2804, the processor 2230 may receive a user inputdragging the widget of the second application in the second direction,while displaying the widget of the second application and the firstexecutable object within the second partial area. For example, referringto FIG. 29 , in the state 2700, the processor 2230 may receive a userinput 2902 dragging the widget 2312 of the second application in thesecond direction, while displaying the widget 2312 of the secondapplication and the first executable object 2314 within the secondpartial area 2304. For example, the user input 2902 may be initiatedfrom a first executable element 2312-1 and may be initiated from asecond executable element 2312-2. As another example, referring to FIG.29 , in a state 2720, the processor 2230 may receive a user input 2922dragging the widget 2312 of the second application in the seconddirection, while displaying the widget 2312 of the second applicationand the first executable object 2314 within the second partial area2304. For example, the user input 2922 may be initiated from the firstexecutable element 2312-1 and may be initiated from the secondexecutable element 2312-2.

In an operation 2806, the processor 2230 may switch the widget of thesecond application displayed within the second partial area to thereduced widget of the second application, in response to receiving theuser input dragging the widget of the second application displayed inthe second partial area in the second direction. In various embodiments,the amount of information provided through the reduced widget of thesecond application may be less than or equal to the amount ofinformation provided through the widget of the second application. Invarious embodiments, the number of executable elements included in thereduced widget of the second application may be less than or equal tothe number of executable elements included in the widget of the secondapplication. In various embodiments, the size of each of the executableelements included in the reduced widget of the second application may beless than or equal to the size of each of the executable elementsincluded in the widget of the second application, although it is notlimited thereto.

In various embodiments, since the reduced widget of the secondapplication has a shorter length than the widget of the secondapplication, the second partial area may provide more additionalinformation than when including the widget of the second application,while including the reduced widget of the second application. Althoughnot shown in FIG. 29 , it is note that when the second partial areaincludes the reduced widget of the second application, the secondpartial area may further provide information or an executable object notprovided when the second partial area includes the widget of the secondapplication, but it is not limited thereto.

For example, referring to FIG. 29 , the processor 2230 may switch thestate 2700 to a state 2910 in response to receiving the user input 2902.In the state 2910, the processor 2230 may display the reduced widget2912 of the second application switched from the widget 2312 of thesecond application. The reduced widget 2912 of the second applicationmay provide a less amount of information than the widget 2312 of thesecond application. For example, the reduced widget 2912 of the secondapplication may not include information on a song being played, includedin the widget 2312 of the second application.

In various embodiments, the length of the reduced widget 2912 of thesecond application may be changed according to the length of the dragpath of the user input 2902. For example, when the length of the dragpath of the user input 2902 is a first length, the length of the reducedwidget 2912 of the second application has a third length, while when thelength of the drag path of the user input 2902 is a second length longerthan the first length, the length of the reduced widget 2912 of thesecond application may have a fourth length shorter than the thirdlength. The reduced widget 2912 of the second application having thefourth length may include less information or a smaller number ofexecutable elements than the reduced widget 2912 of the secondapplication having the third length, although it is not limited thereto.According to embodiments, when the length of the drag path of the userinput 2902 becomes shorter than a specified length, the widget 2312 ofthe second application may switch to the second executable object 2414.When the widget 2312 of the second application switches to the secondexecutable object 2414, the processor 2230 may stop executing the secondapplication. However, it is not limited thereto.

Meanwhile, the first executable object 2314 disposed on the right sideof the widget 2312 of the second application may be moved according tothe switching from the widget 2312 of the second application to thereduced widget 2912 of the second application. For example, the distancebetween the first executable object 2314 and the left edge or a leftperiphery of the second partial area 2304 in state 2700 may be longerthan the distance between the first executable object 2314 and the leftedge of the second partial area 2304.

For another example, referring again to FIG. 29 , the processor 2230 mayswitch the state 2720 to a state 2930 in response to receiving the userinput 2922. In the state 2720, the display position of the firstexecutable object 2314 disposed on the left side of the widget 2312 ofthe second application may be maintained independently of the switchingfrom the widget 2312 of the second application to the reduced widget2912 of the second application. For example, the distance between thefirst executable object 2314 and the left edge of the second partialarea 2304 in the state 2720 may be the same as the distance between thefirst executable object 2314 and the left edge of the second partialarea 2304 in the state 2930.

FIGS. 28 and 29 illustrate an example in which the widget of the secondapplication switches to the reduced widget of the second application,but it is noted that this is merely for convenience of description. Themethod defined through the description of FIGS. 28 and 29 may be used toreduce the extended widget of the second application defined through thedescription of FIGS. 26 and 27 .

As described above, the electronic device 2210 according to variousembodiments makes it possible to switch the widget of the application tothe reduced widget of the application based on a user input to thewidget of the application in execution, so as to provide an interfacefor providing additional information within the second partial area. Theelectronic device 2210 according to various embodiments can provide itsuser with more enhanced user experience, thanks to providing such aninterface.

FIG. 30 illustrates a flowchart for a method of the electronic deviceswitching an executable object displayed on a display into a widget,according to various embodiments. This method may be executed by theinfotainment device 100, the control device 2100 or the electronicdevice 2210, or may be executed by the processor 2230.

FIG. 31 shows an example of switching an executable object into a widgetof an application according to various embodiments.

Referring now to FIG. 30 , in an operation 3002, the processor 2230 maydisplay the execution screen of the first application within the firstpartial area, and display a third executable object to indicate a thirdapplication together with the widget of the second application and thefirst executable object within the second partial area. For example,referring then to FIG. 31 , the processor 2230, as seen in the state2300, may display the execution screen 2310 of the first application inthe first partial area 2302 and display the third executable object 2315together with the widget 2312 of the second application and the firstexecutable object 2314.

In an operation 3004, the processor 2230 may receive a user input 3110dragging the third executable object in the first direction, whiledisplaying the execution screen of the first application in the firstpartial area and displaying the third executable object together withthe widget of the second application and the first executable objectwithin the second partial area. For example, referring then to FIG. 31 ,the processor 2230 may receive the user input 3110 in the state 2300.

In an operation 3006, the processor 2230 may execute the thirdapplication in response to receiving the user input. For example, thethird application may be an application installed in the electronicdevice 2210. As another example, the third application may be anapplication installed in another electronic device distinguished fromthe electronic device 2210 (e.g., the electronic device 2220 or anotherelectronic device located in the vehicle as distinct from the electronicdevice 2220), although not limited thereto.

In an operation 3008, the processor 2230 may switch the third executableobject displayed in the second partial area into the widget of the thirdapplication in response to the execution of the third application.

Meanwhile, the processor 2230 may maintain displaying the executionscreen of the first application in the first partial area displaying thewidget of the second application and the first executable object withinthe second partial area, independently of receiving of the user inputand execution of the third application. For example, the thirdapplication may be executed based on the user input received in theoperation 3004 as well as another user input to the third executableobject. For example, the third application may be executed based on asingle tap input to the third executable object. The processor 2230 mayexecute the third application in response to receiving the single tapinput to the third executable object, and switch the execution screen ofthe first application displayed in the first partial area to theexecution screen of the third application in response to the executionof the third application and switch the first executable objectdisplayed in the second partial area to the widget of the firstapplication. In other words, based on the user input in the operation3004 distinguished from the other user input, the processor 2230 maymaintain displaying the execution screen of the first application in thefirst partial area and displaying the first executable object within thesecond partial area, instead of switching the execution screen of thefirst application displayed in the first partial area into the executionscreen of the third application and switching the first executableobject displayed in the second partial area into the widget of the firstapplication.

For example, referring again to FIG. 31 , the processor 2230 may switchthe state 2300 to a state 3120, in response to execution of the thirdapplication caused by the user input 3110. In the state 3120, theprocessor 2230 may switch the third executable object 2315 displayed inthe second partial area 2304 to the widget 3122 of the thirdapplication. In the state 3120, the processor 2230 may maintaindisplaying the execution screen 2310 of the first application within thefirst partial area 2302 and maintain displaying the widget 2312 of thesecond application and the first executable object 2314 within thesecond partial area 2304, independently of the switching from the state2300 to the state 3120.

In various embodiments, the widget 3122 of the third application mayinclude a visual object for selecting a target temperature around thedriver's seat inside the vehicle, a visual object for selecting aninterior wind direction, a visual object to select whether to activatethe air conditioning, a visual object for selecting an air-blowingamount, and a visual object for selecting a target temperature around apassenger seat in the vehicle. In various embodiments, in the widget3122 of the third application, each of the visual object for selecting atarget temperature around the driver's seat inside the vehicle, thevisual object for selecting an interior wind direction, the visualobject to select whether to activate the air conditioning, the visualobject for selecting an air-blowing amount, and the visual object forselecting a target temperature around a passenger seat in the vehiclemay be formed of an executable object, although it is not limitedthereto.

As seen from the foregoing description, the electronic device 2210according to various embodiments can establish user inputs for executingan application in various types, so that it can selectively provideeither one of switching the execution screen displayed in the firstpartial area, or maintaining the execution screen displayed in the firstpartial area and switching the executable object displayed in the secondpartial area to the widget, other than switching the execution screen.Thus, the electronic device 2210 according to various embodiments canprovide its user with more enhanced user experience owing to such aselective provision of the switching operation.

FIG. 32 illustrates a flowchart for a method of the electronic devicefor providing a functional service based on a user input to an emptyspace of the second partial area, according to various embodiments. Thismethod may be executed by the infotainment device 100, the controldevice 2100 or the electronic device 2210, or may be executed by theprocessor 2230.

FIG. 33 illustrates an example of displaying an executable object andexecuting a particular function indicated by the executable object,based on the user input to the empty space of the second partial areaaccording to various embodiments.

Referring now to FIG. 32 , in an operation 3202, the processor 2230 mayreceive a user input to another area within the second partial area thatis distinct from the display area of the widget of the secondapplication and the display area of the first executable object. Forexample, the other area within the second partial area may be an areawithin the second partial area that is not occupied by the widget of thesecond application and the first executable object. For example,referring then to FIG. 33 , in the state 2300, the processor 2230 mayreceive an user input 3300 to the empty space of the second partial area2304 (e.g., another area within the second partial area) displaying thewidget of the second application and the first executable object.

In an operation 3204, the processor 2230 may display, in response toreceiving the user input, the third executable object to indicate afunction distinguished from the functions available through the firstapplication and the second application, together with the widget of thesecond application and the first executable object within the secondpartial area. For example, the function indicated by the thirdexecutable object may be the function most recently served in theelectronic device 2210 among a plurality of functions, which isavailable through the electronic device 2210 and distinguished from thefunctions available through the first application and the secondapplication. As another example, the function indicated by the thirdexecutable object may be the function most frequently served in theelectronic device 2210 among the plurality of functions, which isavailable through the electronic device 2210 and distinguished from thefunctions available through the first application and the secondapplication. However, it is not limited thereto.

In various embodiments, the third executable object may be displayed ata location within the second partial area that received the user inputin an operation 3202. For example, referring again to FIG. 33 , theprocessor 2230 may switch the state 2300 to a state 3301 in response toreceiving a user input 3300. In the state 3301, the processor 2230 mayadditionally display the third executable object 3310 within the secondpartial area 2304. For example, the third executable object 3310 may bedisplayed at a location within the second partial area at which the userinput 3300 was received. As another example, the third executable object3310 may be displayed in an empty space within the second partial area2304, although it is not limited thereto.

In various embodiments, the third executable object 3310 may includeinformation (e.g., “call XX”) for guiding the function executed throughthe third executable object 3310.

In an operation 3206, the processor 2230 may receive a user input to thethird executable object displayed within the second partial area. Forexample, referring to FIG. 33 , the processor 2230 may receive a userinput 3311 in the state 3301.

In an operation 3208, in response to receiving the user input in theoperation 3206, the processor 2230 may execute the function indicated bythe third executable object.

For example, referring again to FIG. 33 , in response to receiving theuser input 3311 in the state 3301, the processor 2230 may perform a callapplication to provide the function executed through the thirdexecutable object 3310, and switch the state 3301 to a state 3312. Inthe state 3312, the processor 2230 may display the execution screen 3314of the third application (e.g., the call application) that has beenswitched from the execution screen 2310 of the first application withinthe first partial area 2302. In the state 3312, the processor 2230 maydisplay the widget 2412 of the first application switched from the firstexecutable object 2314 within the second partial area 2304. Theswitching from the first executable object 2314 to the widget 2412 ofthe first application may be executed based on the switching from theexecution screen 2310 of the first application to the execution screen3314 of the third application. In the state 3312, the processor 2230 maykeep displaying the widget 2312 of the second application within thesecond partial area 2304. In the state 3312, the processor 2230 may stopdisplaying the third executable object 3310 within the second partialarea 2304.

As another example, referring to FIG. 33 , the processor 2230, inresponse to receiving the user input 3311 in the state 3301, may executethe call application to provide the function executed through the thirdexecutable object 3310, and switching the state 3301 to a state 3320. Inthe state 3320, the processor 2230 may keep displaying the executionscreen 2310 of the first application within the first partial area 2302.In the state 3320, the processor 2230 may keep displaying the widget2312 of the second application in the second partial area 2304. In thestate 3320, the processor 2230 may display the widget 3322 of the thirdapplication switched from the executable object 2317 for indicating thethird application within the second partial area 2304. The switchingfrom the executable object 2317 to the widget 3322 of the thirdapplication may be executed based on the execution of the thirdapplication. The widget 3322 of the third application switched from theexecutable object 2317 may include a first executable element forindicating that an outgoing call to XX is being executed and a secondexecutable element for stopping the execution of the outgoing call toXX. In various embodiments, processor 2230 may switch the state 3320 tothe state 3312 based on receiving a user input for the first executableelement. In various embodiments, the processor 2230 may stop executingthe outgoing call to XX, based on receiving a user input to the secondexecutable element. Further, in the state 3320, the processor 2230 maystop displaying the third executable object 3310 within the secondpartial area 2304.

In various embodiments, the processor 2230 may selectively provide boththe switching from the state 3301 to the state 3312 and the switchingfrom the state 3301 to the state 3320, or either one of the switchingfrom the state 3301 to the state 3312 and the switching from the state3301 to the state 3320. For example, if there is one user input definedin the electronic device 2210 to execute the function indicated by thethird executable object 3310, then the processor 2230 may provide anyone of the switching from the state 3301 to the state 3312 and theswitching from the state 3301 to the state 3320. As another example,when there are two or more user inputs defined in the electronic device2210 to execute the function indicated by the third executable object3310, the processor 2230 may provide both the switching from the state3301 to the state 3312 and the switching from the state 3301 to thestate 3320. For example, if the attribute of the user input 3311 is afirst attribute, the processor 2230 may execute the switching from thestate 3301 to the state 3312, while if the attribute of the user input3311 is a second distinct from the first attribute, then it may executethe switching from the state 3301 to the state 3320.

As described above, the electronic device 2210 according to variousembodiments can, based on receiving a user input to an empty space ofthe second partial area, display an executable object for executinganother function distinct from at least one function available throughat least one application being executed, and execute the other functionbased on receiving a user input to the executable object. The electronicdevice 2210 according to various embodiments can simplify the user inputfor executing the other function provided through the executable object,by means of displaying of such an executable object and execution of theother function. In other words, the electronic device 2210 according tovarious embodiments can provide its user with more enhanced userexperience.

FIG. 34 illustrates a flowchart for a method of the electronic devicefor switching the third executable object defined through thedescription of FIGS. 32 and 33 into a fourth executable object,according to various embodiments. This method may be executed by theinfotainment device 100, the control device 2100 or the electronicdevice 2210, or may be executed by the processor 2230.

FIG. 35 illustrates an example of switching the third executable objectdefined through the description of FIGS. 32 and 33 into the fourthexecutable object, according to various embodiments.

Referring now to FIG. 34 , in an operation 3402, the processor 2230 maydisplay the third executable object defined through the descriptions ofFIGS. 32 and 33 within the second partial area. For example, referringthen to FIG. 35 , in a state 3301, the processor 2230 may display theexecution screen 2310 of the first application within the first partialarea 2302 and then display the widget 2312 of the second application,the first executable object 2314, and the third executable object 3310within the second partial area 2304.

In an operation 3404, the processor 2230 may receive a user input to thethird executable object displayed within the second partial area. Theuser input received in the operation 3404 may be distinguished from theuser input received in an operation 3206. For example, the user inputreceived in the operation 3206 may be a single tap input to the thirdexecutable object, and the user input received in the operation 3404 maybe a drag input to the third executable object. For example, referringto FIG. 35 , the processor 2230 may receive a user input 3500 to thethird executable object 3310 in a state 3301. In various embodiments,when the user input 3500 is a drag input, a dragging direction of thedrag input may be variously set. For example, the user input 3500 may bea drag input of dragging the third executable object 3310 toward theexecution screen 2310 of the first application, as in the state 3301.For another example, unlike the state 3301, a user input 3500 may be aninput of dragging the third executable object 3310 to the right,although it is not limited thereto.

In an operation 3406, the processor 2230 may switch the third executableobject into a fourth executable object in response to receiving the userinput in an operation 3404. In various embodiments, the fourthexecutable object may be used to indicate a function that isdistinguished from the functions available through the firstapplication, the second application and the third executable object. Forexample, the function indicated by the fourth executable object may be afunction most recently provided through the electronic device 2210 amonga plurality of functions, which are available through the electronicdevice 2210 and distinguished form the functions available through thefirst application, the second application and the third executableobject. For another example, the function indicated by the fourthexecutable object may be a function most frequently provided through theelectronic device 2210 among the plurality of functions, which areavailable through the electronic device 2210 and distinguished form thefunctions available through the first application, the secondapplication and the third executable object.

In various embodiments, the fourth executable object may be displayed inan area corresponding to the area displaying the third executableobject. For example, referring again to FIG. 35 , the processor 2230 mayswitch the state 3301 to a state 3501 in response to receiving the userinput 3500. In the state 3501, the processor 2230 may display the fourthexecutable object 3510 switched from the third executable object 3310within the second partial area 2304.

In various embodiments, the fourth executable object 3510 may includeinformation for guiding the function executed through the fourthexecutable object 3510 (e.g., removing window-fogging in the vehicle).

In an operation 3408, the processor 2230 may receive the user input tothe fourth executable object displayed in the second partial area. Forexample, referring to FIG. 35 , the processor 2230 may receive a userinput 3515 in the state 3501.

In an operation 3410, the processor 2230 may execute the functionindicated by the fourth executable object in response to receiving theuser input in the operation 3408. For example, referring to FIG. 35 ,the processor 2230 may use an air conditioning device to perform thefunction to remove window-fogging within the vehicle, in response toreceiving the user input 3515 to the fourth executable object 3510.

Although not shown in FIG. 35 , in some embodiments, the processor 2230may, in response to receiving the user input 3515 to the fourthexecutable object 3510, switch the execution screen 2310 of the firstapplication displayed within the first partial area 2302 to theexecution screen of the application for de-fogging a window in thevehicle, and stop displaying the fourth executable object 3510 withinthe second partial area 2304. Although not shown in FIG. 35 , in someother embodiments, the processor 2230 may, in response to receiving theuser input 3515 to the fourth executable object 3510, switch theexecutable object 2315 displayed within the second partial area 2304 toa widget of the application for defogging, and stop displaying thefourth executable object 3510 within the second partial area 2304.However, it is not limited thereto.

As described above, the electronic device 2210 according to variousembodiments can provide a service for converting the third executableobject defined through the description of FIGS. 32 and 33 into thefourth executable object. The electronic device 2210 according tovarious embodiments can simplify a user input for a user to execute afunction provided through the fourth executable object through provisionof such a service. In other words, the electronic device 2210 accordingto various embodiments can provide its user with more enhanced userexperience through provision of such a service.

FIG. 36 illustrates a flowchart for a method of the electronic devicefor executing a function of an application that provides an executionscreen based on a user input for an empty space in the second partialarea, according to various embodiments. This method may be executed bythe infotainment device 100, the control device 2100 or the electronicdevice 2210, or may be executed by the processor 2230.

FIG. 37 illustrates an example of changing a state of an executionscreen displayed in the first partial area based on a user input to anempty space of the second partial area according to various embodiments.

Referring now to FIG. 36 , in an operation 3602, the processor 2230 maydisplay the execution screen of the first application within the firstpartial area, and display the widget of the second application and thefirst executable object within the second partial area. For example,referring then to FIG. 37 , the processor 2230 may display the executionscreen 2310 of the first application within the first partial area 2302,as in the state 2300, and display the widget 2312 of the secondapplication and the first executable object 2314 within the secondpartial area 2304.

In an operation 3604, the processor 2230 may receive a user input toanother area within the second partial area, which is distinct from thedisplay area of the widget of the second application and the displayarea of the first executable object. For example, the other area withinthe second partial area may be an area that is not occupied by thewidget of the second application and the first executable object withinthe second partial area.

For example, the user input received in the operation 3604 may bedistinguished from the user input received in the operation 3202 and theuser input received in an operation 3404, although it is not limitedthereto.

For example, referring again to FIG. 37 , the processor 2230, in thestate 2300, may receive an user input 3700 to a blank space within thesecond partial area 2304 (e.g., other area within the second partialarea) displaying the widget of the second application and the firstexecutable object.

In an operation 3606, the processor 2230 may execute the function of thefirst application indicated by the user input to the other area withinthe second partial area, in response to receiving the user input. Invarious embodiments, the function of the first application indicated bythe user input received in an operation the 3604 may be variouslyconfigured. For example, the function of the first application indicatedby the user input received in the operation 3604 may be a function thatis distinguished from functions available through the execution screenof the first application. For another example, the function of the firstapplication indicated by the user input received in the operation 3604may be a function most frequently provided among the functions availablethrough the first application. For another example, the function of thefirst application indicated by the user input received in the operation3604 may be a function associated with the service being providedthrough the first application (e.g. the function to change a route tothe destination to another route). For another example, the function ofthe first application indicated by the user input received in theoperation 3604 may be a function most recently provided among thosefunctions available through the first application. However, it is notlimited thereto.

In an operation 3608, the processor 2230 may change the state of theexecution screen of the first application displayed within the firstpartial area, based on the execution of the function of the firstapplication in the operation 3606. For example, referring to FIG. 37 ,the processor 2230 may execute the function of the first applicationindicated by the user input 3700, in response to receiving the userinput 3700, and switch the state 2300 into a state 3701 in response tothe execution of the function of the first application. In the state3701, the processor 2230 may change a route provided in the state 2300to another route, and then change the state of the execution screen 2310of the first application to guide the changed other routing path. Forexample, in the state 3701, the processor 2230 may change the routeguided within the execution screen 2310 of the first applicationprovided in the state 2300 to the other route.

As described above, the electronic device 2210 according to variousembodiments can control the application to provide the execution screendisplayed within the first partial area, based on a user input to anempty space within the second partial area. The electronic device 2210according to various embodiments enables providing such an easy controlto make a user input required for the control more convenient. In otherwords, the electronic device 2210 according to various embodiments canprovide its user with more enhanced user experience through moresimplified user input.

FIG. 38 illustrates a flowchart for a method of the electronic deviceexecuting a function of an application providing a widget, based on auser input to an empty space of the second partial area, according tovarious embodiments. This method may be executed by the infotainmentdevice 100, the control device 2100 or the electronic device 2210, ormay be executed by the processor 2230.

FIG. 39 illustrates an example of changing a state of a widget of anapplication displayed within the second partial area, based on a userinput to the empty space of the second partial area, according tovarious embodiments.

Referring now to FIG. 38 , in an operation 3802, the processor 2230 maydisplay the execution screen of the first application within the firstpartial area and display the widget of the second application and thefirst executable object within the second partial area. For example,referring then to FIG. 39 , the processor 2230, as seen in the state2300, may display the execution screen 2310 of the first applicationwithin the first partial area 2302 and display the widget 2312 of thesecond application and the first executable object 2314 within thesecond partial area 2304.

In an operation 3804, the processor 2230 may receive a user input toother area within the second partial area, which area is distinguishedfrom the display area of the widget of the second application and thedisplay area of the first executable object. For example, the other areawithin the second partial area may be an area that is not occupied bythe widget of the second application and the first executable objectwithin the second partial area.

For example, the user input received in the operation 3804 may bedistinguished from the user input received in the operation 3202 and theuser input received in the operation 3404. According to variousembodiments, the user input received in the operation 3804 may bedistinguished from the user input received in the operation 3604,although it is not limited thereto.

For example, referring again to FIG. 39 , in the state 2300, theprocessor 2230 may receive a user input 3900 for an empty space withinthe second partial area (e.g., the other area within the second partialarea) displaying the widget of the second application and the firstexecutable object.

In an operation 3806, the processor 2230 may execute, in response toreceiving the user input, the function of the second applicationindicated by the user input to the other area within the second partialarea. In various embodiments, the function of the second applicationindicated by the user input received in an operation the 3804 may beconfigured in various ways. For example, the function of the secondapplication indicated by the user input received in the operation 3804may be a function that is distinguished from those functions availablethrough the widget of the second application. For another example, thefunction of the second application indicated by the user input receivedin the operation 3804 may be a function most frequently provided amongthe functions available through the second application. For anotherexample, the function of the second application indicated by the userinput received in the operation 3804 is a function associated with theservice being provided through the second application (e.g., a functionto play a next song of the song being currently playing). For anotherexample, the function of the second application indicated by the userinput received in the operation 3804 may be a function most recentlyprovided among those functions available through the second application.However, it is not limited thereto.

In an operation 3808, the processor 2230 may change the state of thewidget of the second application displayed in the second partial area,based on the execution of the function of the second application in anoperation 3806. For example, referring again to FIG. 39 , the processor2230 may execute the function of the second application indicated a userinput 3900 in response to receiving the user input 3900, and switch thestate 2300 to a state 3901 in response to the execution of the functionof the second application. In the state 3901, the processor 2230 maychange the song (e.g., “Motion”) currently played in the state 2300 to anext song (e.g., “Everything”) and then change the state of the widget2312 of the second application to guide that the next song is now beingplayed. For example, in the state 3901, the processor 2230 may changethe currently playing song guided in the widget 2312 of the secondapplication provided in the state 2300 to the next song.

FIG. 39 illustrates an example in which the dragging direction of theuser input 3900 is made in the same way as the dragging direction of theuser input 3700 of FIG. 37 , but the user input 3700 and the user input3900 may be defined in different ways within the electronic device 2210,in case where the electronic device 2210 is configured to perform bothof the method defined through the description of FIGS. 36 and 37 and themethod defined through the description of FIGS. 38 and 39 . In otherwords, it should be noted that the user input received in the operation3804 may be distinguished from the user input received in the operation3604, when the electronic device 2210 is configured to perform both themethod defined through the description of FIGS. 36 and 37 and the methoddefined through the description of FIGS. 38 and 39 .

As described above, the electronic device 2210 according to variousembodiments can control an application to provide a widget displayedwithin the second partial area, based on a user input to an empty spacewithin the second partial area. The electronic device 2210 according tovarious embodiments may simplify a user input required for the controlthanks to providing such a convenient control. In other words, theelectronic device 2210 according to various embodiments can provide itsuser with more enhanced user experience through a simplified user input.

FIG. 40 illustrates a flowchart for a method of the electronic devicefor displaying a handwriting input field based on a user input to anempty space in the second partial area, according to variousembodiments. This method may be executed by the infotainment device 100,the control device 2100 or the electronic device 2210, or may beexecuted by the processor 2230.

FIG. 41 illustrates an example of the handwriting input field displayedaccording to the user input for the empty space within the secondpartial area according to various embodiments.

Referring now to FIG. 40 , in an operation 4002, the processor 2230 maydisplay the execution screen of the first application within the firstpartial area and display the widget of the second application and thefirst executable object within the second partial area and. For example,referring then to FIG. 41 , the processor 2230, as in the state 2300,may display the execution screen 2310 of the first application withinthe first partial area 2302 and the widget 2312 of the secondapplication and the first executable object 2314 within the secondpartial area.

In an operation 4004, the processor 2230 may receive a user input toother area within the second partial area, which is distinguished fromthe display area of the widget of the second application and the displayarea of the first executable object. For example, the other area withinthe second partial area may be an area within the second partial areathat is not occupied by the widget of the second application and thefirst executable object.

For example, the user input received in the operation 4004 may bedistinguished from the user input received in the operation 3202. Forexample, the user input received in the operation 4004 may bedistinguished from the user input received in an operation 3404. Forexample, the user input received in an operation the 4004 may bedistinguished from at least one of the user input received in theoperation 3604 or the user input received in the operation 3804.However, it is not limited thereto.

For example, referring again to FIG. 41 , in the state 2300, theprocessor 2230 may display a user input 4100 for an empty space withinthe second partial area 2304 (e.g., other area within the second partialarea) displaying the widget of the second application and the firstexecutable object.

In an operation 4006, in response to receiving the user input, theprocessor 2230 may display the handwriting input field in an overlappingmanner on the execution screen of the first application displayed withinthe first partial area. In various embodiments, the handwriting inputfield may be extended from at least a part of the second partial area.In some embodiments, the handwriting input field may be configured to betranslucent so that a part of the execution screen of the firstapplication disposed underneath the handwriting input field can bevisually recognized.

For example, referring to FIG. 41 , the processor 2230 may switch thestate 2300 to a state 4101 in response to receiving a user input 4100 inthe state 2300. In the state 4101, the processor 2230 may display thehandwriting input field 4102 in an overlapping manner on the executionscreen 2310 of the first application. In various embodiments, thehandwriting input field 4102 may provide a space for receiving ahandwritten input and displaying the received handwritten input.

In an operation 4008, the processor 2230 may receive at least one draginput initiated from the handwriting input field. In variousembodiments, the processor 2230 may identify, based on identifying afirst drag input that is received first after displaying the handwritinginput field, identify whether or not a second drag input following thefirst drag input is received for a specified time period from the timingpoint of receiving the first drag input. For example, the processor 2230may recognize the first drag input and the second drag input as thehandwritten input, based on identifying that the second drag input isreceived for the specified time period from the timing point at whichthe first drag input was received. For another example, the processor2230 may recognize only the first drag input as the handwritten input,based on identifying that the second drag input is not received for thespecified time period from the timing point at which the first draginput is received. However, it is not limited thereto.

For example, referring again to FIG. 41 , the processor 2230 may receiveat least one drag input 4104 initiated from the handwriting input field4102, in a state 4101.

In an operation 4010, the processor 2230 may recognize a characterindicated by the path of the at least one drag input. For example, theprocessor 2230 may recognize a character indicated by a first drag inputpath and a second drag input path, based on identifying that a thirddrag input is not received for the specified time period from the timingpoint at which the second drag input following the first drag input wasreceived. For example, referring to FIG. 41 , the processor 2230 mayrecognize a character (e.g., “Home” in Korean language) indicated by apath of at least one drag input 4104 received in a state 4101.

In an operation 4012, the processor 2230 may execute a functioncorresponding to the recognized character. For example, referring againto FIG. 41 , the processor 2230 may recognize a character (e.g., “home”)based on the path of at least one drag input 4104 received in the state4101 and execute a function corresponding to the recognized character,such as, e.g., a function to execute an outgoing call to the user's homeusing a call application, a function to set the destination of thevehicle for the driver's home using a navigation application, a functionto retrieve and play a song entitled “Home” using a music application,or the like.

In some embodiments, the handwriting input field 4102 may furtherdisplay a plurality of executable objects 4106 to indicate each of theplurality of applications within the handwriting input field 4102, so asto further specify the function corresponding to the recognizedcharacter. When the handwriting input field 4102 further comprises aplurality of executable objects 4106 and receives a user input 4108 toselect one executable object of the plurality of executable objects4106, the processor 2230 may execute an application indicated by theexecutable object selected by the user input 4108 and the functioncorresponding to the recognized character (e.g., executing an outgoingcall to the user's home using the call application).

As described above, the electronic device 2210 according to variousembodiments can execute the function corresponding to the path, bydisplaying the handwriting input field based on a user input to theempty space of the second partial area and recognizing the path of atleast one drag input received through the handwriting input field. Theelectronic device 2210 according to various embodiments can simplify auser input required to execute the corresponding function through thehandwriting input field. In other words, the electronic device 2210according to various embodiments makes it possible to render moreenhanced user experience through such a simplified user input.

FIG. 42 illustrates a flowchart for a method of the electronic devicefor processing a drag input initiated from the handwriting input fielddisplayed according to various embodiments. This method may be executedby the infotainment device 100, the control device 2100 or theelectronic device 2210, or may be executed by the processor 2230.

FIG. 43 illustrates an example of processing a drag input passing from ahandwriting input field to a part of the first partial area beyond thehandwriting input field according to various embodiments.

Referring now to FIG. 42 , in an operation 4202, the processor 2230 maydisplay the handwriting input field in an overlapping manner on theexecution screen of the first application displayed in the first partialarea. For example, the operation 4202 may correspond to the operation4006.

In an operation 4204, the processor 2230 may receive at least one draginput initiated from the handwriting input field. For example, referringthen to FIG. 43 , the processor 2230 may receive at least one drag input4305 initiated from the handwriting input field 4102 in a state 4301.

In an operation 4206, the processor 2230 may recognize, as part of acharacter, the at least one drag input passing by part of the executionscreen of the first application beyond the handwriting input field whilereceiving the at least one drag input. For example, referring again toFIG. 43 , the processor 2230 may receive at least one drag input 4305initiated from the handwriting input field 4102 in the state 4301. Theprocessor 2230, while receiving the at least one drag input 4305, mayrecognize the path 4307 of the at least one drag input 4305 passing bypart of the execution screen 2310 of the first application within thefirst partial area 2302, as part of the character instead of a userinput to the execution screen 2310 of the first application. In variousembodiments, the processor 2230 may display part of the path of the atleast one drag input (e.g., the path 4307) on the execution screen 2310of the first application displayed within the first partial area.

As described above, the electronic device 2210 according to variousembodiments can recognize, in response to identifying that a drag inputis initiated from the handwriting input field, a path of a drag inputpassing by part of the execution screen of the first application withinthe first partial area beyond the handwriting input field, as part ofthe handwriting input, and identify a character, based on therecognition. For example, the electronic device 2210 according tovarious embodiments can maintain, in response to identifying that such adrag input is initiated from the handwriting input field, displaying ofthe execution screen of the first application in the first partial areaand deactivate recognition of a touch input on the execution screen ofthe first application in the first partial area, so that it is possibleto recognize the path of the drag input passing by the execution screenof the first application within the first partial area beyond thehandwriting input field, as part of the handwriting input, and identifya character based on the recognition. The electronic device 2230according to various embodiments makes it possible to enhance the user'sconvenience thanks to the execution of such a recognition.

FIG. 44 illustrates a flowchart for a method of the electronic device ofdisplaying an executable object for guiding a recommended functionwithin a portion of the second partial area, according to variousembodiments. This method may be executed by the infotainment device 100,the control device 2100 or the electronic device 2210, or may beexecuted by the processor 2230.

FIG. 45 illustrates an example of the executable object for guiding therecommended function displayed within a portion of the second partialarea according to various embodiments.

Referring first to FIG. 44 , in an operation 4402, the processor 2230may display the execution screen of the first application within thefirst partial area and display an executable object for guiding therecommended function together with the first executable object and thewidget of the second application within the second partial area. Invarious embodiments, the recommended function may be identified from amodel, in association with the electronic device 2210, configured topredict a future executable pattern of the electronic device 2210 basedon past execution heuristics including the past execution history of theelectronic device 2210. For example, the model may be disposed eitherinside the electronic device 2210 or outside the electronic device 2210.For example, when the model is disposed outside the electronic device2210, the model may be stored within a server located out of theelectronic device 2210 and connected by the electronic device 2210,although it is not limited thereto. The model may be a model configuredto receive information on executions caused by the electronic device2210 to be trained based on the received information.

In various embodiments, the executable object for guiding therecommended function may be displayed in any other area within thesecond partial area, which is distinguished from the area displaying thefirst executable object and the widget of the second application. Forexample, referring then to FIG. 45 , in the state 2300, the processor2230 may display an executable object 4500 for guiding the recommendedfunction within the other area of the second partial area 2304 that isdistinguished from the area displaying the widget 2312 of the secondapplication and the first executable object 2314. For example, theexecutable object 4500 may include a text to guide the recommendedfunction (such as, e.g., “Monday! Let's cheer up for this week aswell!”).

In an operation 4404, the processor 2230 may identify whether the userinput received for the executable object is a drag input. For example,the user input received for the executable object may include a userinput for executing the recommended function guided by the executableobject and a user input for switching the executable object into anotherexecutable object for guiding other recommended function distinct forthe recommended function. The processor 2230 may identify whether or notthe user input received for the executable object is the drag input, inorder to identify whether the user input received for the executableobject is a user input to execute the recommended function guided by theexecutable object or a user input to switch the executable object to theother executable object for guiding the other recommended function. Forexample, if the user input received for the executable object is thedrag input, then the processor 2230 may execute the operation 4406, orotherwise, execute the operation 4408.

In the operation 4406, the processor 2230 may switch the executableobject to the other executable object in response to identifying thatthe user input received for the executable object is the drag input. Forexample, the other recommended function guided by the other executableobject may be a function with a priority immediately next to thepriority of the recommended function, among a plurality of recommendedfunctions identified by the model. For example, referring again to FIG.45 , in response to receiving a user input 4504 for the executableobject 4500 in the state 2300, the processor 2230 may switch the state2300 to a state 4506. In the state 4506, the processor 2230 may displaythe other executable object 4510 switched from the executable object4500 within the second partial area 2304. For example, the otherexecutable object 4510 may include a text (such as, e.g., “Shall wesearch for nearby nice restaurants?”) to guide the other recommendedfunction. In various embodiments, the processor 2230 may execute theoperation 4404 again after completing execution of the operation 4406.

In an operation 4408, in response to identifying that the user inputreceived for the executable object is not the drag input, or that theuser input received for the executable object is distinguished from thedrag input, the processor 2230 may execute the function indicated by theexecutable object (e.g., the recommended function). For example,referring again to FIG. 45 , the processor 2230 may execute, in responseto receiving a user input 4502 for the executable object 4500 in thestate 2300, the recommended function guided by the executable object4500 (e.g., executing a route guidance to the driver's workplace usingthe navigation application). However, it is not limited thereto.

As described above, the electronic device 2210 according to variousembodiments makes it possible to display an executable object to executea recommended function from such a trained model within a portion of thesecond partial area, in order to provide a service better suited to theelectronic device 2210 or the user's situation of the electronic device2210. The electronic device 2210 according to various embodiments canprovide its user with more enhanced convenience, owing to displaying ofthe executable object.

FIG. 46 illustrates a flowchart illustrating a method of the electronicdevice for displaying a plurality of executable objects extending from aportion of the second partial area according to various embodiments.This method may be executed by the infotainment device 100, the controldevice 2100 or the electronic device 2210, or may be executed by theprocessor 2230.

FIG. 47 illustrates an example of a plurality of executable objectsextending from a portion of the second partial area according to variousembodiments.

Referring now to FIG. 46 , in an operation 4602, the processor 2230 maydisplay the execution screen of the first application within the firstpartial area and display an executable object for guiding a recommendedfunction along with the first executable object and the widget of thesecond application within the second partial area. For example, theoperation 4602 may correspond to the operation 4402. For example,referring then to FIG. 47 , in the state 2300, the processor 2230 maydisplay an executable object 4500 for guiding the recommended functionwithin other area of the second partial area 2304, which isdistinguished from an area displaying the widget 2312 of the secondapplication and the first executable object 2314. For example, theexecutable object 4500 may include a text to guide the recommendedfunction (such as, e.g., “Monday! Let's cheer up for this week aswell!”).

In an operation 4604, the processor 2230 may identify whether the userinput received for the executable object is a drag input. For example,the user input received for the executable object may include a userinput for executing the recommended function guided by the executableobject, and a user input for maintaining to display the executableobject and for displaying a plurality of executable objects forrespectively guiding a plurality of recommended functions distinguishedfrom the recommended function, in an overlapping manner, on theexecution screen of the first application displayed within the firstpartial area. The processor 2230 may identify whether or not the userinput received for the executable object is the drag input, in order toidentify whether the user input received for the executable object isthe user input for executing the recommended function guided by theexecutable object, or whether it is a user input for displaying aplurality of executable objects for respectively guiding a plurality ofrecommended functions distinguished from the recommended function, in anoverlapping manner, on the execution screen of the first applicationdisplayed in the first partial area. For example, when the user inputreceived with respect to the executable object is the drag input, theprocessor 2230 may execute the operation 4606, or otherwise, execute theoperation 4612.

In the operation 4606, the processor 2230 may, in response toidentifying that the user input received for the executable object isthe drag input, maintain displaying of the executable object and displaythe plurality of executable objects in an overlapping manner on theexecution screen of the first application within the first partial area.For example, the plurality of executable objects may be extended fromthe executable object. For example, the plurality of recommendedfunctions each guided by the plurality of executable objects may befunctions that are identified from the model and have the priority lowerthan that of the recommended function. For example, referring now toFIG. 47 , the processor 2230 may, in response to receiving a user input4704 for the executable object 4500 in the state 2300, switch the state2300 to a state 4706. In the state 4706, the processor 2230 may maintaindisplaying of the executable object 4500. In the state 4706, theprocessor 2230 may display a plurality of executable objects 4708 withinan area overlapping the execution screen of the first application in thefirst partial area 2302 and extending from the executable object 4500.

In an operation 4608, the processor 2230 may receive a user input forselecting any one from among the executable object and the plurality ofexecutable objects. For example, referring again to FIG. 47 , in a state4706, the processor 2230 may receive the user input 4710 for selectingany one from among the executable object 4500 and the plurality ofexecutable objects 4708.

In an operation 4610, the processor 2230 may execute a recommendedfunction guided by the executable object selected by the user input, inresponse to the user input received in the operation 4608. For example,referring again to FIG. 47 , in state 4706, the processor 2230 mayperform, in response to receiving the user input 4710, a windowdefogging function, which is a function guided by the executable objectselected by user input 4710.

In an operation 4612, the processor 2230 may, in response to identifyingthat the user input received for the executable object is the drag inputor identifying that the user input received for the executable object isdistinguished from the drag input, execute the function indicated by theexecutable object. For example, referring to FIG. 47 , the processor2230 may execute, in response to receiving the user input 4502 for theexecutable object 4500 in the state 2300, the recommended functionguided by the executable object 4500 (e.g., executing a route guidanceto the driver's workplace using the navigation application). However, itis not limited thereto.

As described above, the electronic device 2210 according to variousembodiments makes it possible to display a plurality of executableobjects for guiding each of a plurality of recommended functions,thereby extending the range of selection for the services better suitedto the situation around the electronic device 2210 or its user.Therefore, the electronic device 2210 according to various embodimentscan provide its users with more enhanced convenience owing to displayingof such a plurality of executable objects.

FIG. 48 illustrates a flowchart for a method of the electronic devicefor displaying a split screen within a first partial area, by dropping awidget of an application displayed in a second partial area in the firstpartial area, according to various embodiments. This method may beexecuted by the infotainment device 100, the control device 2100 or theelectronic device 2210, or may be executed by the processor 2230.

FIG. 49 illustrates an example of such a split screen within the firstpartial area displayed by dropping a widget of an application displayedin the second partial area in the first partial area, according tovarious embodiments.

Referring now to FIG. 48 , in an operation 4802, the processor 2230 maydisplay the execution screen of the first application within the firstpartial area and display the first executable object and the firstexecutable object and the widget of the second application within thesecond partial area. For example, referring then to FIG. 49 , in thestate 2300, the processor 2230 may display the execution screen 2310 ofthe first application within the first partial area 2302 and display thewidget 2312 of the second application and the first executable object2314 within the second partial area 2304.

In an operation 4804, the processor 2230 may receive a user inputdropped in the first partial area after dragging the widget of thesecond application. For example, referring to FIG. 49 , in the state2300, the processor 2230 may receive a user input 4900 or a user input4910 dropping in the first partial area 2302 after dragging the widget2312 of the second application. Although not illustrated in FIG. 49 , insome embodiments, the processor 2230 may display a shadow image of thewidget 2312 of the second application in order to compensate the widget2312 of the second application for at least partially being covered bythe user's finger causing the user input 4900 or 4910, while the userinput 4900 or 4910 is maintained. In an embodiment, the shadow image maybe configured to be translucent in order to enhance visibility of a partof the execution screen 2310 of the first application within the firstpartial area 2302 located underneath the shadow image.

In an operation 4806, the processor 2230 may, in response to receivingthe user input in the operation 4804, display a reduced execution screenof the first application switched from the execution screen of the firstapplication and a reduced execution screen of the second applicationwithin the first partial area, and display the first executable objectand the second executable object of the second application that isswitched from the widget of the second application within the secondpartial area.

For example, referring then to FIG. 49 , the processor 2230 may switchthe state 2300 to a state 4902 in response to receiving a user input4900 in the state 2300. In the state 4902, the processor 2230 maydisplay a reduced execution screen 4906 of the first applicationswitched from the execution screen 2310 of the first application and areduced execution screen 4904 of the second application within the firstpartial area 2302. In the state 4902, the processor 2230 may display thefirst executable object 2314 and the second executable object 2414switched from the widget 2312 of the second application within thesecond partial area 2304. In various embodiments, the reduced executionscreen 4906 of the first application may have a smaller size than theexecution screen 2310 of the first application. In various embodiments,the reduced execution screen 4906 of the first application may includevisual objects with a reduced size compared to the execution screen 2310of the first application. In various embodiments, the reduced executionscreen 4906 of the first application may display a less amount ofinformation than the execution screen 2310 of the first application. Invarious embodiments, the reduced execution screen 4906 of the firstapplication may display a smaller amount of executable elements than theexecution screen 2310 of the first application. In various embodiments,the arrangement of visual objects and executable elements within thereduced execution screen 4906 of the first application may bedistinguished from the arrangement of those visual objects andexecutable elements within the execution screen 2310 of the firstapplication. However, it is not limited thereto.

Although the execution screen 2402 of the second application is notshown in FIG. 49 , in various embodiments, the reduced execution screen4904 of the second application may have a reduced size compared to theexecution screen 2402 of the second application. In various embodiments,the reduced execution screen 4904 of the second application may includevisual objects with a smaller size than the execution screen 2402 of thesecond application. In various embodiments, the reduced execution screen4904 of the second application may display a less amount of informationthan the execution screen 2402 of the second application. In variousembodiments, the reduced execution screen 4904 of the second applicationmay display a smaller amount of executable elements than the executionscreen 2402 of the second application. In various embodiments, thearrangement of visual objects and executable elements within the reducedexecution screen 4904 of the second application may be distinguishedfrom the arrangement of those visual objects and executable elements inthe execution screen 2402 of the second application, although it is notlimited thereto.

For another example, referring again to FIG. 49 , the processor 2230 mayswitch the state 2300 to another state 4912 in response to receiving auser input 4910 in the state 2300. In the state 4912, the processor 2230may display a reduced execution screen 4906 of the first applicationswitched from the execution screen 2310 of the first application and areduced execution screen 4904 of the second application within the firstpartial area 2302. In the state 4912, the processor 2230 may display thefirst executable object 2314 and the second executable object 2414switched from the widget 2312 of the second application within thesecond partial area 2304.

In various embodiments, the processor 2230 may configure in a differentway the arrangement of the reduced execution screen of the firstapplication and the reduced execution screen of the second applicationdisplayed within the first partial area, depending on a position wherethe widget of the second application is dropped by the user inputreceived in the operation 4804. For example, referring to FIG. 49 , theprocessor 2230 may switch the state 2300 to the state 4902, in responseto receiving the user input 4900 dropping the widget 2312 of the secondapplication in an area located on the left side about the center linethrough the first partial area 2302 in the vertical direction from thestate 2300. Depending on the dropped position of the widget 2312 of thesecond application, the arrangement of the reduced execution screen 4906of the first application and the reduced execution screen 4904 of thesecond application in the state 4902 may be made so that the reducedexecution screen 4904 of the second application is disposed to the leftside of the reduced execution screen 4906 of the first application. Foranother example, referring to FIG. 49 , the processor 2230 may switchthe state 2300 to the state 4912, in response to receiving the userinput 4910 dropping the widget 2312 of the second application in an arealocated on the right side about the center line through the firstpartial area 2302 in the vertical direction from the state 2300.Further, depending on the dropped position of the widget 2312 of thesecond application, the arrangement of the reduced execution screen 4906of the first application and the reduced execution screen 4904 of thesecond application in the state 4912 may be made so that the reducedexecution screen 4904 of the second application is disposed to the rightside of the reduced execution screen 4906 of the first application.

As described above, the electronic device 2210 according to variousembodiments can display, in response to receiving a user input droppinga widget of an application displayed within the second partial area ontoan execution screen of another application displayed in the firstpartial area, a split screen configured of a reduced execution screen ofthe application and a reduced execution screen of the other applicationwithin the first partial area. The electronic device 2210 according tovarious embodiments can provide its user with more enhanced userexperience, owing to providing such a split screen through an intuitiveuser input like the aforementioned user input.

FIG. 50 illustrates a flowchart for a method of an electronic device fordisplaying a split screen within the first partial area by dropping ontothe first partial area a plurality of executable objects displayedwithin the second partial area, according to various embodiments. Thismethod may be executed by the infotainment device 100, the controldevice 2100 or the electronic device 2210, or may be executed by theprocessor 2230.

FIG. 51 illustrates an example of a split screen displayed within thefirst partial area by dropping onto the first partial area a pluralityof executable objects displayed within the second partial area,according to various embodiments.

FIG. 52 illustrates an example of a split screen with an arrangementchanged according to a position within the first partial area dropping aplurality of executable objects displayed within the second partialarea, according to various embodiments.

Referring now to FIG. 50 , in an operation 5002, the processor 2230 maydisplay the first executable object and the second executable objectwithin the second partial area. Further, in various embodiments, theprocessor 2230 may not display any execution screen within the firstpartial area, while displaying the first executable object and thesecond executable object within the second partial area. For example,when an application executed in relation to the electronic device 2210is only a system application, the processor 2230 may display noexecution screen within the first partial area, while displaying thefirst executable object and the second executable object within thesecond partial area. For example, referring then to FIG. 51 , in a state5100, the processor 2230 may display a blank screen 5102 within thefirst partial area 2302 and display the first executable object 2314 andthe second executable object 2414 within the second partial area 2304.

In an operation 5004, the processor 2230 may receive a user inputdragging both the first executable object and the second executableobject and then dropping them in the first partial area, whiledisplaying the first executable object and the second executable objectwithin the second partial area without displaying any execution screenin the first partial area. For example, referring then to FIG. 51 , inthe state 5100, the processor 2230 may receive a user input to drag boththe first executable object 2314 and the second executable object 2414,and then drop them into the first partial area 2302 including a blankscreen.

In an operation 5006, the processor 2230 may execute the firstapplication and the second application in response to receiving the userinput in an operation 5004. In various embodiments, when executing aplurality of applications concurrently or when a time interval betweentimings of executing each of a plurality of applications is less than orequal to a specified time, the processor 2230 may prefetch at least apart of instructions composing the first application and at least a partof instructions composing the second application into the memory 2235,in response to the initiation of the user input received in theoperation 5004, so that the user can quickly feel the executing speed ofthe plurality of applications. For example, as soon as both the firstexecutable object and the executable object are dragged by the userinput in the operation 5004, the processor 2230 may prefetch at least aportion of the instructions for executing the first application and atleast a portion of the instructions for executing the second applicationinto the memory 2235. The processor 2230 can quickly execute the firstapplication and the second application, by providing the memory 2235with the remaining instructions of the instructions for executing thefirst application and providing the memory 2235 with the remaininginstructions of the instructions for executing the second application,in response to identifying that the first executable object and thesecond executable object are dropped within the first partial area by auser input in the operation 5004 after executing the prefetch. However,it is not limited thereto.

In an operation 5008, the processor 2230 may display, in response toexecuting the first application and the second application, the reducedexecution screen of the first application and the reduced executionscreen of the second application within the first partial area. Forexample, referring again to FIG. 51 , the processor 2230 may execute thefirst application and the second application in response to receiving auser input 5104 in a state 5100, and switch the state 5100 to a state5106 in response to completing the executions of the first applicationand the second application. In the state 5106, the processor 2230 maydisplay the reduced execution screen 4906 of the first application andthe reduced execution screen 4904 of the second application within thefirst partial area 2302. For example, in the state 5106 switched fromthe state 5100, a blank screen 5102 included within the first partialarea 2302 may be switched to a reduced execution screen 4906 of thefirst application and a reduced execution screen 4904 of the secondapplication. On the other hand, in the state 5106, the first executableobject 2314 and the second executable object 2414 may be highlightedrelative to other executable objects within the second partial area2304.

In the state 5106, the processor 2230 may receive a user input 5108 formoving the boundary between the reduced execution screen 4906 of thefirst application and the reduced execution screen 4904 of the secondapplication. The processor 2230 may change the size of the reducedexecution screen 4906 of the first application and the size of thereduced execution screen 4904 of the second application in response toreceiving the user input 5108. For example, when receiving the userinput 5108 configured with a drag input in the first direction, theprocessor 2230 may extend the reduced execution screen 4906 of the firstapplication and further reduce the reduced execution screen 4904 of thesecond application. For another example, when receiving the user input5108 configured with a drag input in the second direction opposite tothe first direction, the processor 2230 may reduce the reduced executionscreen 4906 of the first application and extend the reduced executionscreen 4904 of the second application.

In the state 5106, the processor 2230 may receive a user input 5110 tothe reduced execution screen 4906 of the first application. In variousembodiments, the user input 5110 may have a property that isdistinguished from user inputs for executable elements within thereduced execution screen 4906 of the first application. This may be todistinguish the user input 5110 from the executable elements within thereduced execution screen 4906 of the first application, even if the userinput 5110 is caused in an area where the executable elements within thereduced execution screen 4906 of the first application are located. Forexample, the user input 5110 may consist of an input double-tapping thereduced screen 4906 of the first application, while the user inputs forthe executable elements within the reduced execution screen 4906 of thefirst application may consist of inputs single-tapping the executableelements. The processor 2230 may switch, in response to receiving theuser input 5110, the reduced execution screen 4906 of the firstapplication displayed and the reduced execution screen 4904 of thesecond application, displayed within the first partial area 2302, to theexecution screen of the first application. Further, in response toreceiving the user input 5110, the processor 2230 may switch the secondexecutable object 2414 displayed within the second partial area 2304 tothe widget 2312 of the second application.

In the state 5106, the processor 2230 may receive a user input 5112 forthe reduced execution screen 4904 of the second application. In variousembodiments, the user input 5112 may have a property that isdistinguished from user inputs for executable elements within thereduced execution screen 4904 of the second application. This may be todistinguish the user input 5112 from the executable elements within thereduced execution screen 4904 of the second application, even if theuser input 5112 is caused in an area where the executable elementswithin the reduced execution screen 4904 of the second application arelocated. For example, the user input 5112 may consist of an inputdouble-tapping the reduced screen 4904 of the second application, andthe user inputs for executable elements in the reduced execution screen4904 of the second application Inputs may consist of inputssingle-tapping the executable elements. The processor 2230 may switch,in response to receiving the user input 5112, the reduced executionscreen 4906 of the first application and the reduced execution screen4904 of the second application, displayed in the first partial area2302, to the execution screen 2402 of the second application. Inresponse to receiving the user input 5112, the processor 2230 may switchthe first executable object 2314 displayed within the second partialarea 2304 to the widget 2412 of the first application.

In various embodiments, the processor 2230 may configure the arrangementof the reduced execution screen of the first application and the reducedexecution screen of the second application displayed within the firstpartial area, in a different way, depending on a position where thefirst executable object and the second executable object are dropped bythe user input received in the operation 5004. For example, referring toFIG. 52 , the processor 2230 may switch the state 5100 to the state5214, in response to receiving the user input 5202 dropping the firstexecutable object 2314 and the second executable object 2414 in an areaformed on the left side about the center line through the first partialarea 2302 in the vertical direction from the state 5100. Depending onthe dropped position of the first executable object 2314 and the secondexecutable object 2414, the arrangement of the reduced execution screen4906 of the first application and the reduced execution screen 4904 ofthe second application in the state 5214 may be made so that the reducedexecution screen 4904 of the second application is disposed to the rightside of the reduced execution screen 4906 of the first application,which is of the same arrangement as that of the first executable object2314 and the second executable object 2414. For another example,referring again to FIG. 52 , the processor 2230 may switch the state5100 to the state 5106, in response to receiving the user input 4910dropping the first executable object 2314 and the second executableobject 2414 into an area formed to the right side about the center linethrough the first partial area 2302 in the vertical direction from thestate 5100. Further, according to the dropped position of the firstexecutable object 2314 and the second executable object 2414, thearrangement of the reduced execution screen 4906 of the firstapplication and the reduced execution screen 4904 of the secondapplication in the state 5106 may be made so that the reduced executionscreen 4904 of the second application is disposed to the left side ofthe reduced execution screen 4906 of the first application, which is ofa different arrangement as that of the first executable object 2314 andthe second executable object 2414.

As described above, the electronic device 2210 according to variousembodiments can display, in response to receiving a user input droppinga plurality of executable objects displayed within the second partialarea into the first partial area, execution screens of a plurality ofapplications indicated by the plurality of executable objects as a splitscreen. The electronic device 2210 according to various embodiments canprovide its user with more enhanced user experience, thanks to providingsuch a split screen using an intuitive user input like the above userinput.

FIG. 53 illustrates a flowchart for an operation method of theelectronic device displaying a split screen within the first partialarea, by dropping a plurality of executable objects displayed within thesecond partial area into the first partial area including an executionscreen of an application, according to various embodiments. This methodmay be executed by the infotainment device 100, the control device 2100or the electronic device 2210, or may be executed by the processor 2230.

FIG. 54 illustrates an example of such a split screen displayed in thefirst partial area by dropping a plurality of executable objectsdisplayed in the second partial area into the first partial areaincluding an execution screen of an application, according to variousembodiments.

Referring now to FIG. 53 , in an operation 5302, the processor 2230 maydisplay an execution screen of the third application within the firstpartial area, and display a first executable object, a first executableobject and a third executable object within the second partial area. Forexample, referring then to FIG. 54 , in a state 5400, the processor 2230may display the execution screen 5401 of the third application withinthe first partial area 2302, and display the first executable object2314, the second executable object 2414, and the third executable object2317 within the second partial area 2304. The third executable object2317 may be highlighted relative to the first executable object 2314 andthe second executable object 2414 to indicate that the third applicationis being executed.

In an operation 5304, the processor 2230 may receive a user input thatis dropped in the first partial area after dragging both the firstexecutable object and the second executable object displayed within thesecond partial area. For example, referring to FIG. 54 , in the state5400, the processor 2230 may receive a user input 5402 dropped in thefirst partial area 2302 including the execution screen 5401 of the thirdapplication after dragging both the first executable object 2314 and thesecond executable object 2414.

In an operation 5306, the processor 2230 may execute the firstapplication and the second application in response to receiving the userinput in an operation 5304. In various embodiments, when executing aplurality of applications concurrently or when a time interval betweentimings of executing each of a plurality of applications is less than orequal to a specified time, the processor 2230 may prefetch at least apart of instructions composing the first application and at least a partof instructions composing the second application into the memory 2235,in response to the initiation of the user input received in theoperation 5304, so that the user can quickly feel the executing speed ofthe plurality of applications. For example, as soon as both the firstexecutable object and the executable object are dragged by the userinput in the operation 5304, the processor 2230 may prefetch at leastsome of the instructions for executing the first application and atleast some of the instructions for executing the second application intothe memory 2235. The processor 2230 can quickly execute the firstapplication and the second application, by providing the memory 2235with the remaining instructions of the instructions for executing thefirst application and also providing the memory 2235 with the remaininginstructions of the instructions for executing the second application,in response to identifying that the first executable object and thesecond executable object are dropped within the first partial area bythe user input in the operation 5304 after executing the prefetch.However, it is not limited thereto.

In an operation 5308, the processor 2230, in response to executing thefirst application and the second application, may display a reducedexecution screen of the first application and a reduced execution screenof the second application within the first partial area, and a widget ofthe third application switched from the third executable object withinthe second partial area. For example, the execution screen of the thirdapplication displayed in the first partial area may be switched, inresponse to executing the first application and the second application,to the reduced execution screen of the first application and the reducedexecution screen of the second application within the first partialarea. For example, the execution screen of the third applicationdisplayed within the first partial area may be switched to the widget ofthe third application displayed within the second partial area. Forexample, referring again to FIG. 54 , in response to receiving the userinput 5402 in the state 5400, the processor 2230 may execute the firstapplication and the second application, and in response to completingthe executions of the first application and the second application, theprocessor may switch the state 5400 to the state 5410. The processor2230 may, in the state 5410, display the reduced execution screen 4906of the first application and the reduced execution screen 4904 of thesecond application within the first partial area 2302. For example, inthe state 5410 switched from the state 5400, the execution screen 5401of the third application included within the first partial area 2302 maybe switched to the reduced execution screen 4906 of the firstapplication and the reduced execution screen 4904 of the secondapplication. For example, in the state 5410 switched from the state5400, the execution screen 5401 of the third application included withinthe first partial area 2302 may be switched to the widget 5405 of thethird application within the second partial area 5410.

Although not shown in FIG. 54 , the processor 2230 may determine thearrangement of the reduced execution screen 4906 of the firstapplication and the reduced execution screen 4904 of the secondapplication, depending on the location of the first executable object2314 and the second executable object 2414 dropped by the user input5402 received in the state 5400.

As described above, the electronic device 2210 according to variousembodiments can display, in response to receiving a user input droppinga plurality of executable objects displayed within the second partialarea onto the first partial area including an execution screen of anapplication, execution screens of a plurality of applications indicatedby the plurality of executable objects within the first partial area, asa split screen, and display an widget of the application within thesecond partial area. The electronic device 2210 according to variousembodiments can provide its user with more enhanced user experiencethanks to providing such a split screen and a widget through anintuitive user input as in the above user input.

FIG. 55 illustrates a flowchart for an operation method of theelectronic device for moving a widget or an executable object within asecond partial area based on identifying a designated event from apassenger seat of the vehicle according to various embodiments. Thismethod may be executed by the infotainment device 100, the controldevice 2100 or the electronic device 2210, or may be executed by theprocessor 2230.

FIG. 56 illustrates an example of a widget or an executable objectwithin the second partial area that may be moved based on identifying anevent designated from the passenger seat according to variousembodiments.

Referring first to FIG. 55 , in an operation 5502, the processor 2230may display the execution screen of the first application within thefirst partial area, and display the widget of the second application andthe first executable object within the second partial area. For example,referring then to FIG. 56 , in a state 2300, the processor 2230 maydisplay the execution screen 2310 of the first application within thefirst partial area 2302 and then display the widget 2312 of the secondapplication and the first executable object 2314 within the secondpartial area 2304.

In an operation 5504, the processor 2230 may identify an eventdesignated from the passenger seat of the vehicle, while displaying theexecution screen of the first application within the first partial areaand displaying the widget of the second application and the firstexecutable object within the second partial area. The identification ofthe designated event may be set in various ways. For example, theidentification of the designated event may be executed by identifying ahovering input or a gesture input on the display area configured of thefirst partial area and the second partial area while identifying thatboth hands of the driver are in contact with a steering wheel of thevehicle. For example, the identification of the designated event may beperformed by identifying at least one of a change in weight of a usersitting in the passenger seat of the vehicle or a change in tension of aseat belt worn by the user sitting in the passenger seat of the vehicle.For example, the identification of the designated event may be performedby identifying that the position where the user's hand has entered thedisplay area is located closer to the passenger seat of the vehicle thanto the driver's seat of the vehicle.

For example, referring again to FIG. 56 , the processor 2230 mayidentify a designated event 5610 in the state 2300. For example, theidentification of the designated event 5610 may be performed byidentifying a hovering input, a gesture input or a touch input on orover the display area configured of the first partial area and thesecond partial area, while identifying that both hands are in contactwith the steering wheel of the vehicle. For example, the hovering input,the gesture input or the touch input may be identified with at least onetouch sensor in the display 2240. For another example, the hoveringinput, the gesture input or the touch input may be identified with acamera 2247. However, it is not limited thereto.

For another example, referring again to FIG. 56 , the processor 2230 mayidentify the designated event 5620 in the state 2300. For example, theidentification of the designated event 5620 may be performed byidentifying at least one of a change in weight of the user sitting inthe passenger seat of the vehicle or a change in tension of the seatbelt worn by the user sitting in the passenger seat of the vehicle. Forexample, the change in weight may be identified by means of a sensor2249 mounted in conjunction with the passenger seat. For example, thechange in tension may be identified by means of the sensor 2249 mountedin conjunction with the seat belt of the passenger seat. However, it isnot limited thereto.

As another example, referring to FIG. 56 , the processor 2230 mayidentify the designated event 5630 in the state 2300. For example, theidentification of the designated event 5630 may be performed byidentifying that the position where the user's hand has entered thedisplay area is closer to the passenger seat of the vehicle than to thedriver's seat of the vehicle. For example, the identifying that theposition where the user's hand has entered the display area is closer tothe passenger seat of the vehicle than to the driver's seat of thevehicle may be executed by means of at least one touch sensor in thedisplay 2240, although not limited thereto.

In an operation 5506, the processor 2230 may move, in response toidentifying the designated event in an operation 5504, at least one ofthe widget of the second application and the first executable objectwithin the second partial area, displayed closer to the driver's seat ofthe vehicle than to the passenger seat of the vehicle. For example, ifthe widget of the second application of the widget of the secondapplication and the first executable object within the second partialarea is located closer to the driver's seat of the vehicle than to thepassenger seat of the vehicle, then the processor 2230 may move only thewidget of the second application of the widget of the second applicationand the first executable object. The moved widget of the secondapplication may be displayed within the second partial area closer tothe passenger seat of the vehicle than to the driver's seat of thevehicle. For another example, if the first executable object of thewidget of the second application and the first executable object withinthe second partial area is located closer to the driver's seat of thevehicle than to the passenger seat of the vehicle, then the processormay move only the first executable object of the widget of the secondapplication and the first executable object. The moved first executableobject may be displayed within the second partial area closer to thepassenger seat of the vehicle than to the driver's seat of the vehicle.For another example, if both the widget of the second application andthe first executable object in the second partial area are locatedcloser to the driver's seat of the vehicle than to the passenger seat ofthe vehicle, then the processor 2230 may move both the widget of thesecond application and the first executable object. The moved widget ofthe second application and the moved first executable object may bedisplayed within the second partial area closer to the passenger seat ofthe vehicle than to the driver's seat of the vehicle.

For example, referring now to FIG. 56 , the processor 2230 may switchthe state 2300 to the state 5650, in response to identifying at leastone of a designated event 5610, a designated event 5620, or a designatedevent 5630 in the state 2300. In the state 5650, the processor 2230 maydisplay the widget 2312 of the second application, the first executableobject 2314, the executable object 2315, the executable object 2316, andthe executable object 2317, at a position within the second partial area2304 moved to the right relative to the state 2300. In the state 5650,the processor 2230 may display information receiving no user input (suchas e.g., time information) at a position moved to the left, as differentfrom the widget 2312 of the second application, the first executableobject 2314, and the executable object 2315, the executable object 2316,and the executable object 2317.

In the meantime, although not shown in FIGS. 55 and 56 , the processor2230 may move, in response to identifying the designated event in theoperation 5504, at least one executable element in the execution screenof the first application within the first partial area displayed closerto the driver's seat of the vehicle than to the passenger seat of thevehicle. For example, the moved at least executable element may bedisplayed within the first partial area, closer to the passenger seat ofthe vehicle than to the driver's seat of the vehicle.

As described above, the electronic device 2210 according to variousembodiments makes it possible to identify a designated event from thepassenger seat, and in response to and in response to theidentification, move at least one of at least one executable object, atleast one executable element, or at least one widget, so as for thedriver sitting in the passenger seat to more conveniently control atleast one of the at least one executable object, the at least oneexecutable element, or the at least one widget, included within thefirst partial area or the second partial area. The electronic device2210 according to various embodiments can provide its user with moreenhanced user experience owing to such movement of at least one of theat least one executable object, the at least one executable element, orthe at least one widget.

FIG. 57 illustrates a flowchart for a method of the electronic devicefor extending the second partial area based on a hovering input,according to various embodiments. This method may be executed by theinfotainment device 100, the control device 2100 or the electronicdevice 2210, or may be executed by the processor 2230.

FIG. 58 illustrates an example of the second partial area extended basedon a hovering input according to various embodiments.

Referring now to FIG. 57 , in an operation 5702, the processor 2230 maydisplay an execution screen of the first application within the firstpartial area and display a widget of the second application and thefirst executable object within the second partial area, while thevehicle equipped with the electronic device 2210 is moving. For example,referring then to FIG. 58 , in the state 2300, the processor 2230 maydisplay the execution screen 2310 of the first application within thefirst partial area 2302 and display the widget 2312 of the secondapplication and the first executable object 2314 within the secondpartial area 2304.

In an operation 5704, the processor 2230 may identify a hovering inputfor the second partial area, while displaying the execution screen ofthe first application within the first partial area and the widget ofthe second application and the first executable object within the secondpartial area, while the vehicle equipped with the electronic device 2210is moving. For example, the hovering input may be a hovering inputcaused by a user's hand spaced apart from the second partial area andpositioned above the second partial area. For example, referring to FIG.58 , in the state 2300, the processor 2230 may identify the hoveringinput 5800 for the second partial area 2304.

In an operation 5706, the processor 2230 may extend, in response toidentifying the hovering input in the operation 5704, the second partialarea and then extend the widget of the second application and the firstexecutable object within the second partial area.

In some embodiments, the size of the first partial area may bemaintained independently from the extension of the second partial area.When the size of the first partial area is maintained independently ofthe extension of the second partial area, a part of the extended secondpartial area may be overlapped with at least a part of the first partialarea on which the execution screen of the first application isdisplayed. For example, referring to FIG. 58 , the processor 2230 mayswitch the state 2300 to the state 5801 in response to receiving thehovering input 5800 in the state 2300. In the state 5801, the processor2230 may extend the second partial area 2304. In the state 5801, theprocessor 2230 may maintain the size of the first partial area 2302independently of the extension of the second partial area 2304. Due tothe maintaining of the size of the first partial area 2302, a part ofthe extended second partial area 2304 may be overlapped on a part of thefirst partial area 2302. For example, a part of the execution screen2310 of the first application in the first partial area 2302 may becovered by a part of the extended second partial area 2304. In someother embodiments, the size of the first partial area may be reduced bythe extension of the second partial area. When the size of the firstpartial area is reduced, the extended second partial area may beadjacent to the reduced first partial area or may be separated from thereduced first partial area. In other words, when the size of the firstpartial area is reduced, the extended second partial area may notoverlap the reduced first partial area. Meanwhile, the execution screenof the first application may be reduced by the reduction of the firstpartial area. Due to the reduction of the execution screen of the firstapplication, a part of the reduced first partial area may be displayedas a black screen. For example, referring to FIG. 58 , the processor2230 may switch the state 2300 to the state 5805 in response toreceiving the hovering input 5800 in the state 2300. In state 5805, theprocessor 2230 may extend the second partial area 2304. In the state5805, the processor 2230 may reduce the size of the first partial area2302 according to the extension of the second partial area 2304. Thereduction in the size of the first partial area 2302 may cause theexecution screen 2310 of the first application in the first partial area2302 to be reduced. Meanwhile, at least a portion of the first partialarea 2302 may be configured as a black screen according to the reductionof the execution screen 2310 of the first application.

In some embodiments, the second partial area may be extended to a sizecorresponding to the moving speed of the vehicle based on identifyingthe hovering input. In some embodiments, each of the widget of thesecond application and the first executable object may be extended to asize corresponding to the moving speed of the vehicle, based on theidentification of the hovering input. In some embodiments, each of thefirst executable element and the second executable element may beextended to a size corresponding to the moving speed of the vehiclebased on identifying the hovering input.

As understood from the foregoing description, the electronic device 2210according to various embodiments makes it possible to improve, relativeto a hovering input for the second partial area, the accuracy of anyuser inputs for the second partial area to be received after receivingthe hovering input, owing to the extended second partial area. Thus, theelectronic device 2210 according to various embodiments can provide itsusers with more enhanced user experience thanks to its improvedmanipulating accuracy.

FIG. 59 illustrates a flowchart for a method of the electronic devicefor extending at least one executable element in an execution screen ofan application within the first partial area based on a hovering input,according to various embodiments. This method may be executed by theinfotainment device 100, the control device 2100 or the electronicdevice 2210, or may be executed by the processor 2230.

FIG. 60 illustrates an example of at least one executable element in anexecution screen of an application within the first partial area that isextended based on a hovering input according to various embodiments.

Referring now to FIG. 59 , in an operation 5902, the processor 2230 maydisplay the execution screen of the first application within the firstpartial area and display the widget of the second application and thefirst executable object within the second partial area, while thevehicle including the electronic device 2210 is moving. For example,referring to FIG. 60 , in the state 2300, the processor 2230 may displaythe execution screen 2310 of the first application within the firstpartial area 2302 and then display the widget 2312 of the secondapplication and the first executable object 2314 within the secondpartial area 2304.

In an operation 5904, the processor 2230 may identify a hovering inputfor the first partial area, while displaying the execution screen of thefirst application within the first partial area and displaying thewidget of the second application and the first executable object withinthe second partial area, with the vehicle equipped with the electronicdevice 2210 moving. For example, the hovering input may be a hoveringinput caused by the user's hand spaced apart from the first partial areaand positioned above the first partial area. For example, referringagain to FIG. 60 , in the state 2300, the processor 2230 may identify ahovering input 6000 for the first partial area 2302.

In an operation 5906, the processor 2230 may extend, in response toidentifying the hovering input in an operation 5904, at least oneexecutable element in the execution screen of the first applicationwithin the first partial area. In various embodiments, the size of thefirst partial area may be maintained independently of the extension ofthe at least one executable element. In various embodiments, the size ofthe second partial area may be maintained independently of the extensionof the at least one executable element. In some embodiments, the size ofat least one visual object within the execution screen of the firstapplication in the first partial area, which is distinct from the atleast one executable element, may be maintained independently of theextension of the at least one executable element. For example, referringagain to FIG. 60 , the processor 2230 may switch the state 2300 to thestate 6001 in response to receiving a hovering input 6000 in the state2300. In the state 6001, the processor 2230 may extend at least oneexecutable element 6003 within the execution screen 2310 of the firstapplication in the first partial area 2302. In the state 6001, the sizeof first partial area 2302 may be maintained independently of theextension of the at least one executable element 6003. In the state6001, the size of second partial area 2304 may be maintainedindependently of the extension of the at least one executable element6003. In some embodiments, the size of at least one visual object (forexample, at least one visual object configuring an electronic map)within the execution screen 2310 of the first application in the firstpartial area 2302, which is distinct from at least one executableelement, may be maintained independently of the extension of the atleast one executable element 6003. However, it is not limited thereto.

As described above, the electronic device 2210 according to variousembodiments makes it possible to improve, based on a hovering input forthe first partial area, the accuracy of a user input for at least oneexecutable element to be received after receiving the hovering input, byextending the at least one executable element of an execution screen ofan application within the first partial area. The electronic device 2210according to various embodiments can provide its user with more enhanceduser experience thanks to providing the improved accuracy in userinputs.

FIG. 61 shows a flowchart for a method of the electronic device fordisplaying a notification message based on a hovering input according tovarious embodiments. This method may be executed by the infotainmentdevice 100, the control device 2100 or the electronic device 2210, ormay be executed by the processor 2230.

FIG. 62 shows an example of a notification message displayed based on ahovering input according to various embodiments.

Referring now to FIG. 61 , in an operation 6102, the processor 2230 maydisplay an execution screen of the first application within the firstpartial area and display a widget of the second application and thefirst executable object within the second partial area, while thevehicle equipped with the electronic device 2210 is travelling. Forexample, referring then to FIG. 62 , in the state 2300, the processor2230 may display the execution screen 2310 of the first applicationwithin the first partial area 2302 and then display the widget 2312 ofthe second application and the first executable object 2314 within thesecond partial area 2304.

In an operation 6104, the processor 2230 may identify a hovering inputfor the display area including the first partial area and the secondpartial area, in case where the speed of the vehicle in travelling isgreater than or equal to a predetermined speed. For example, thepredetermined speed may be a kind of parameter to be set in order toprevent a traffic accident from occurring due to requiring a user inputfor an execution screen, an executable object, or a widget displayed inthe display area, in case where the vehicle is moving at a speedexceeding the predetermined speed limit, the specified speed. In variousembodiments, the predetermined speed may be configured by means ofeither a system setting or a user setting. Further, the hovering inputmay be a hovering input caused by the user's hand spaced apart from thedisplay area and positioned over the display area. For example,referring to FIG. 62 , in the state 2300, the processor 2230 mayidentify a hovering input 6200 for the display area. Although FIG. 62illustrates an example in which the hovering input 6200 is identifiedwithin the first partial area 2302, but it is to be noted that this isonly for convenience of the description. In various embodiments, thehovering input 6200 may be identified within the second partial area2304.

In an operation 6106, the processor 2230 may display, in response toidentifying the hovering input in an operation 6104, a notificationmessage for guiding that a limited control of the execution screen ofthe first application and the widget of the second application is made.In various embodiments, the notification message may be displayed in anoverlapping manner on the execution screen of the first applicationwithin the first partial area. In various embodiments, the processor2230 may deactivate all those executable elements within the executionscreen of the first application and the widget of the secondapplication, while displaying the notification message. In someembodiments, displaying of all the executable elements within theexecution screen of the first application and the widget of the secondapplication may be maintained independently of the deactivation. In someother embodiments, the displaying of all the executable elements withinthe execution screen of the first application and the widget of thesecond application may be changed to indicate such a deactivation. Forexample, the displaying of all the executable elements within theexecution screen of the first application and the widget of the secondapplication may be blurred to indicate the deactivation, although it isnot limited thereto.

For example, referring to FIG. 62 , the processor 2230 may switch thestate 2300 to the state 6201 in response to receiving the hovering input6200 in the state 2300. In the state 6201, the processor 2230 mayfurther display a notification message 6205. In various embodiments, thenotification message 6205 may include a text for guiding thepredetermined speed limit and/or another text for guiding that thelimited control of the execution screen 2310 of the first applicationand the widget 2312 of the second application is made. In variousembodiments, the notification message 6205 may be displayed overlappingon the execution screen 2310 of the first application.

In an operation 6108, the processor 2230 may stop displaying thenotification message based on identifying that a predetermined timeduration has elapsed from the timing at which the notification messagewas displayed. For example, referring to FIG. 62 , the processor 2230may identify whether the predetermined time duration elapses from thetiming of displaying the notification message 6205 in the state 6201,and based on identifying that the predetermined time duration haselapsed from the timing, may switch or restore the state 6201 to thestate 2300. In the state 2300, the processor 2300 may stop displayingthe notification message 6205.

Further, the processor 2230 may identify whether another hovering inputdistinguished from the hovering input identified in the operation 6104is identified, while identifying whether the predetermined time durationhas elapsed from the timing of displaying the notification message. Whenthe other hovering input is identified. The processor 2230 may maintaindisplaying of the notification message, unlike the operation 6108,although it is not limited thereto.

As understood from the foregoing description, the electronic device 2210according to various embodiments makes it possible to interrupt receiptof any user inputs onto a part of the display area of the display 2240capable of receiving the user input, and display the notification orwarning message, thereby preventing a possible traffic accident causedby the user inputs.

FIG. 63 illustrates a flowchart for a method of the electronic devicefor processing any notification related to another application, whichmay be caused while displaying an execution screen of an application,according to various embodiments. This method may be executed by theinfotainment device 100, the control device 2100 or the electronicdevice 2210, or may be executed by the processor 2230.

FIG. 64 illustrates an example of a screen switched based on processingof the notification according to various embodiments.

Referring now to FIG. 63 , in an operation 6302, the processor 2230 mayexecute the first application. For example, the first application may bean application for providing the navigation service.

In an operation 6304, the processor 2230 may, in response to executingthe first application, display an execution screen of the firstapplication within the first partial area, and display the firstexecutable object and the second executable object within the secondpartial area. For example, referring to FIG. 64 , in a state 6400, theprocessor 2230 may display the execution screen 2310 of the firstapplication within the first partial area 2302, and display the firstexecutable object 2314 and the second executable object 2317 within thesecond partial area 2304. For example, the second executable object 2317may be an executable object for indicating a second application.Throughout the description of FIGS. 63 and 64 , the second applicationmay be an application for a call service. In various embodiments, thesecond application indicated by the executable object 2317 may be in astate in which it is not executed, as opposed to the first application.

In an operation 6306, in response to executing the first application,while displaying the execution screen of the first application withinthe first partial area, and displaying the first executable object andthe second executable object within the second partial area, theprocessor 2230 may execute the second application, based on receiving asignal that is distinguished from the functions supported by the firstapplication and related to the functions supported by the secondapplication.

In an operation 6308, the processor 2230 may display, in response toexecuting the second application, a notification for the received signalusing the executed second application, in an overlapping manner, on theexecution screen of the first application. For example, referring toFIG. 64 , the processor 2230 may receive the signal in a state 6400,execute the second application in response to receiving the signal, andswitch the state 6400 to a state 6405 in response to the execution ofthe second application. In the state 6405, the processor 2230 maydisplay a notification 6407 in an overlapping manner on the executionscreen 2310 of the first application displayed within the first partialarea 2302. In state 6405, the processor 2230 may switch a state of thesecond executable object 2317 within the second partial area 2304 from anon-executed state to an executed state. For example, the secondexecutable object 2317 in the state 6405 may be highlighted.

In an operation 6310, the processor 2230 may receive a user input forthe displayed notification. For example, referring to FIG. 64 , theprocessor 2230 may receive a user input 6409 for a notification 6407 inthe state 6405.

In an operation 6312, in response to receiving the user input in anoperation 6310, the processor 2230 may identify whether the firstapplication providing an execution screen within the first partial areais a designated application. In various embodiments, the designatedapplication may be a parameter defined to determine whether to switch anexecution screen of an application displayed within the first partialarea into an execution screen of another application. For example, ifthe execution screen of the application displayed within the firstpartial area is an execution screen of an application related to themovement of the vehicle equipped with the electronic device 2210, thenthe application related to the movement of the vehicle is the designatedapplication. As another example, if the execution screen of theapplication displayed with the first partial area is an execution screenof an application that is not related to the movement of the vehicleequipped with the electronic device 2210, then the application notrelated to the movement of the vehicle may not be the designatedapplication. In various embodiments, the designated application may beregistered by setting in the processor 2230 without any user input, orset by registration according to a user input.

If the first application is the designated application, the processor2230 may execute an operation 6314, or otherwise, it may execute anoperation 6316.

In the operation 6314, the processor 2230 may maintain, in response toidentifying that the first application is the designated application,displaying the execution screen of the first application within thefirst partial area, and switch the second executable object in thesecond partial area into a widget of the second application. Forexample, referring to FIG. 64 , the processor 2230 may switch the state6405 to the state 6411 in response to receiving a user input 6409 in thestate 6405. In the state 6411, the processor 2230 may stop displayingthe notification 6407 within the first partial area 2302. In the state6411, the processor 2230 may display the widget 3322 of the secondapplication switched from the second executable object 2317 within thesecond partial area 2304.

In an operation 6316, the processor 2230 may, in response to identifyingthat the first application is not the designated application oridentifying that the first application is distinct from the designatedapplication, switch the execution screen of the first application in thefirst partial area to the execution screen of the second application,and then switch the first executable object within the second partialarea to the widget of the first application. For example, referring toFIG. 64 , the processor 2230 may switch the state 6405 to the state 6413in response to receiving the user input 6409 in the state 6405. In thestate 6413, the processor 2230 may stop displaying the notification 6507within the first partial area 2302. In the state 6413, the processor2230 may display an execution screen 6415 of the second applicationswitched from the execution screen 2310 of the first application withinthe first partial area 2302. In the state 6413, the processor 2230 maydisplay the widget 2412 of the first application switched from the firstexecutable object 2314 within the second partial area 2304. In variousembodiments, the execution screen 6415 of the second application mayinclude a content related to the notification 6407.

FIG. 63 illustrates an example of displaying a notification for a signalrelated to functions supported by the second application and receiving auser input for the notification, but this is only for convenience of thedescription. For example, when the signal does not request displaying ofthe notification or the second application is an application that doesnot support displaying of the notification, the execution of theoperation 6308 and/or the execution of the operation 6310 may be omittedor skipped, in which case the processor 2230 may execute the operation6306 and thereafter, directly execute the operation 6312 withoutexecuting the operations 6308 and 6310.

Further, although FIG. 63 illustrates an example of executing either theoperation 6314 or the operation 6316 depending on whether the firstapplication is the designated application, this is only for convenienceof the description. For example, in the operation 6312, the processor2230 may compare the priority of the first application and the priorityof the second application, instead of identifying whether the firstapplication is the designated application, and if the priority of thefirst application is higher than the priority of the second application,then it may execute the operation 6314, and otherwise, execute theoperation 6316. In various embodiments, the priority of the firstapplication and the priority of the second application may be determinedby the processor 2230 without a user input therefor, or may bedetermined based on user settings.

As described above, the electronic device 2210 according to variousembodiments makes it possible to make an adaptive switching of anexecution screen of an application according to a signal related toanother application received while displaying the execution screen ofthe application within the first partial area, on basis of the type ofthe application. The electronic device 2210 according to variousembodiments can provide its user with more enhanced user experiencethrough such a switching operation.

FIG. 65 illustrates a flowchart for a method of the electronic devicefor displaying a split screen based on a user input according to variousembodiments. This method may be executed by the infotainment device 100,the control device 2100 or the electronic device 2210, or may beexecuted by the processor 2230.

FIG. 66 illustrates an example of such a split screen displayed based ona user input according to various embodiments.

Referring now to FIG. 65 , in an operation 6502, the processor 2230 maydisplay an execution screen of the first application within the firstpartial area, and display the first executable object and a widget ofthe second application within the second partial area. For example,referring then to FIG. 66 , in the state 2300, the processor 2230 maydisplay an execution screen 2310 of the first application within thefirst partial area 2302, and display a widget 2312 of the secondapplication and the first executable object 2314 within the secondpartial area.

In an operation 6504, the processor 2230 may receive a user input whiledisplaying an execution screen of the first application within the firstpartial area, and displaying the first executable object and a widget ofthe second application within the second partial area. For example,referring then to FIG. 66 , the processor 2230, in the state 2300, mayreceive at least one of a user input 6600-1, a user input 6600-2, a userinput 6600-3 and a user input 6600-4. For example, the user input 6601-1may be a hovering input having a designated pattern generated from auser's hand spaced apart from the display area of the display 2240 andpositioned over the display area. The hovering input may be obtainedthrough a touch sensor related to the display 2240. As another example,the user input 6600-2 may be an eye gaze input caused by viewing thedisplay area for a specified time period. The eye gaze input may beidentified based on an image captured through the camera 2247. Asanother example, the user input 6600-3 may be an input to a physicalinput means equipped with a steering wheel of the vehicle including theelectronic device 2210. The physical input means may include at leastone of a rotatable structure or a physical button. As another example,the user input 6600-4 may be a gesture input having a designated patterngenerated from a user sitting in a driver's seat of the vehicle oranother user sitting in a passenger seat of the vehicle. The gestureinput may be identified based on an image captured through the camera2247.

In an operation 6506, in response to receiving the user input in theoperation 6504, the processor 2230 may switch the execution screen ofthe first application in the first partial area to a reduced executionscreen of the first application and a reduced execution screen of thesecond application, and switch a widget of the second application in thesecond partial area to the second executable object. For example,referring to FIG. 66 , in the state 2300, the processor 2230 may switchthe state 2300 to a state 6602 in response to at least one of the userinput 6600-1, the user input 6600-2, the user input 6600-3, and the userinput 6600-4. In the state 6602, the processor 2230 may display areduced execution screen 4906 of the first application switched from theexecution screen 2310 of the first application and a reduced executionscreen 4904 of the second application within the first partial area2302. In the state 6602, the processor 2230 may display the secondexecutable object 2414 switched from the widget 2312 of the secondapplication within the second partial area 2304.

In some embodiments, the reduced execution screen 4906 of the firstapplication and the reduced execution screen 4904 of the secondapplication displayed in the state 6602 may be in a state that cannotreceive a user input for controlling the first application and thesecond application. The reduced execution screen 4906 of the firstapplication and the reduced execution screen 4904 of the secondapplication displayed in the state 6602 may be in a state that can onlyreceive a user input of selecting either one of the reduced executionscreen 4906 of the first application and the reduced execution screens4904 of the second application. For example, the state 6602 may be of anintermediate state for switching into any one of the state 2300 and thestate 2401. For example, in the state 6602, the processor 2230 mayreceive a user input 6604 for selecting the reduced execution screen ofthe first application of the reduced execution screen 4906 of the firstapplication and the reduced execution screen 4904 of the secondapplication. The processor 2230 may switch the state 6602 to the state2300 in response to receiving the user input 6604 in the state 6602. Foranother example, in the state 6602, the processor 2230 may receive auser input 6606 to select (4904) the reduced execution screen 4904 ofthe second application of the reduced execution screen 4906 of the firstapplication and the reduced execution screen 4904 of the secondapplication. The processor 2230 may switch the state 6602 to the state2401 in response to receiving the user input 6606 in the state 6602.However, it is not limited thereto.

In some embodiments, the user input 6604 and the user input 6606 mayalso be configured as an eye gaze input, when the user input received inthe state 2300 is the user input 6600-2. For example, the user input6604 may be configured of an eye gaze input viewing the reducedexecution screen 4906 of the first application for a specified timeduration, and the user input 6606 may be configured of an eye inputviewing the reduced execution screen 4904 of the second application fora specified time duration. However, it is not limited thereto.

As described above, the electronic device 2230 according to variousembodiments makes it possible to display a split screen based on a userinput distinct from a touch input in order to make simpler the userinput to change the arrangement of the display area provided through thedisplay 2240. The electronic device 2230 according to variousembodiments can provide its user with more enhanced user experienceowing to the simplification of such a user input.

FIG. 67 illustrates a flowchart for a method of the electronic devicefor switching an execution screen of an application within a displayarea of a display to an execution screen of another applicationproviding a reduced execution screen within a display area of anotherdisplay, according to various embodiments. This method may be executedby the infotainment device 100, the control device 2100 or theelectronic device 2210, or may be executed by the processor 2230.

FIG. 68 illustrates an example of exchanging a screen displayed on adisplay with a screen displayed on another display according to variousembodiments.

Referring now to FIG. 67 , in an operation 6702, the processor 2230 maydisplay an execution screen of the first application within the firstpartial area, display the first executable object and the secondexecutable object within the second partial area, and display a reducedexecution screen of the second application on another display. Invarious embodiments, the other display may be a display that isdistinguished from the display having the display area inclusive of thefirst and second partial areas. For example, the other display may be acluster display configured with a display within the vehicle to indicatea moving speed of a vehicle including the electronic device 2210. Foranother example, the other display may be a head up display (HUD) withinthe vehicle including the electronic device 2210. However, it is notlimited thereto. For example, referring then to FIG. 68 , in a state6800, the processor 2230 may provide the state 2300 on the display andthen provide a state 6805 on another display (e.g., the cluster display)distinct from the display. For example, the display providing the state2300 may display an execution screen 2310 of the first applicationwithin the first partial area 2302, and the other display providing thestate 6805 may display a reduced execution screen of the secondapplication.

In an operation 6704, the processor 2230 may receive a user input, whiledisplaying the execution screen of the first application within thefirst partial area, and the first executable object and the secondexecutable object within the second partial area, and displaying thereduced screen of the second application on another display. Forexample, the user input may be an input to a physical input meansequipped within the steering wheel of the vehicle including theelectronic device 2210. The physical input means may include at leastone of a rotatable structure or a physical button, although it is notlimited thereto.

In an operation 6706, the processor 2230, in response to receiving theuser input in the operation 6704, may switch the execution screen of thefirst application within the first partial area to the execution screenof the second application, and switch the reduced execution screen ofthe second application on the other display to the reduced executionscreen of the first application. For example, referring to FIG. 68 , theprocessor 2230 may switch the state 6800 to the state 6810 in responseto receiving a user input in the state 6800. For example, in the state6810, the processor 2230 may provide the state 2401 switched from thestate 2300 on the display and provide a state 6815 switched from thestate 6805 on the other display. For example, the display providing thestate 2401 may display the execution screen 2401 of the secondapplication switched from the execution screen 2310 of the firstapplication within the first partial area 2302, and the other displayproviding the state 6815 may display the execution screen of the firstapplication switched from the reduced execution screen of the secondapplication.

FIG. 69 illustrates a signal flow diagram of controlling the electronicdevice through a second other electronic device of first and secondother electronic devices included in a vehicle, according to variousembodiments. This signal flow may be executed by the infotainment device100, the control device 2100 or the electronic device 2210, or may becaused to operate by the processor 2230, and may be caused to operate bythe first other electronic device (e.g., the electronic device 2220)and/or the second other electronic device within the vehicle.

FIG. 70 illustrates an example of a display screen of the electronicdevice controlled by the second other electronic device according tovarious embodiments.

Referring first to FIG. 69 , in an operation 6922, the electronic device2210 may establish a connection between the electronic device 2210 and afirst other electronic device 6910. In various embodiments, the firstother electronic device 6910 may be an electronic device located withinthe vehicle. In various embodiments, the first other electronic device6910 may be an electronic device for a user sitting in a driver's seatof the vehicle including the electronic device 2210.

In an operation 6924, the electronic device 2210 may establish aconnection between the electronic device 2210 and a second otherelectronic device 6920. In various embodiments, the second otherelectronic device 6920 may be an electronic device included in avehicle. In various embodiments, the second other electronic device 6920may be an electronic device for a user sitting in a passenger seat ofthe vehicle with the electronic device 2210.

In an operation 6926, the electronic device 2210 may receive data fromthe first other electronic device 6910. In various embodiments, the datamay include information for displaying an execution screen of the firstapplication within the first partial area using the display 2240 of theelectronic device 2210 and displaying the first executable object and awidget of the second application within the second partial area.

In an operation 6928, the electronic device 2210 may display theexecution screen of the first application within the first partial areaand the first executable object and the widget of the second applicationwithin the second partial area, based on the data received in theoperation 6926. For example, referring to FIG. 70 , the electronicdevice 2210 and the second other electronic device 6920 may be arrangedwithin a state 7000. The state 7000 may include the state 2300 of theelectronic device 2210 and a state 7005 of the second other electronicdevice 6920. In the state 2300, the electronic device 2210 may display,based on the data received from the first other electronic device 6910,the execution screen 2310 of the first application within the firstpartial area 2302 and display the widget 2312 of the second applicationwithin the second partial area 2304. In the state 7005, the second otherelectronic device 6920 may be in a state in which no user input iscaused in relation to the electronic device 2210.

In an operation 6930, the electronic device 2210 may transmitinformation on the execution screen of the first application andinformation on the widget of the second application to the second otherelectronic device 6920. In various embodiments, the information in anoperation 6930 may be transmitted to the second other electronic device6920 to control the execution screen of the first application displayedwithin the first partial area by the second other electronic device 6920or control the widget of the second application displayed within thesecond partial by the second other electronic device 6920. In variousembodiments, the information transmitted in an operation 6930 may beconfigured to display an execution screen corresponding to the executionscreen of the first application and a widget corresponding to the widgetof the second application on the display of the second other electronicdevice 6920, for the above control.

Further, the second other electronic device 6920 may receive theinformation from the electronic device 2210. In response to receivingthe information, the second other electronic device 6920 may display ascreen on the display of the second other electronic device 6920 basedon the information. The screen may include a screen corresponding to theexecution screen of the first application and a screen corresponding tothe widget of the second application, in order to control the executionscreen of the first application displayed within the first partial areaby the second other electronic device 6920 or control the widget of thesecond application displayed within the second partial area by thesecond other electronic device 6920.

In an operation 6932, the second other electronic device 6920 mayreceive at least one user input for the screen displayed in an operation6930. For example, referring to FIG. 70 , the state 7000 may be switchedto a state 7010 by the at least one user input in an operation 6932. Thestate 7010 may include a state 7012 of the electronic device 2210 and astate 7016 of the second other electronic device 6920. In the state7012, the electronic device 2210 may display information 7014 to notifythat at least one of the execution screen 2310 of the first applicationdisplayed within the first partial area 2302 or the widgets 2312 of thesecond application displayed within the second partial area 2304 isbeing controlled by a passenger of the vehicle. Although not shown inFIG. 69 , the information 6914 may be displayed in an overlapping manneron the execution screen 2310 of the first application within the firstpartial area 2302, based on a signal transmitted to the electronicdevice 2210 while receiving the at least one user input by the secondother electronic device 6920. However, it is not limited thereto.Further, in the state 7016, the second other electronic device 6920 mayreceive the at least one input for the screen displayed in an operation6930.

In an operation 6934, the second other electronic device 6920 maytransmit information on the at least one user input to the electronicdevice 2210. In various embodiments, the information in the operation6934 may be transmitted to control at least one of the execution screenof the first application displayed within the first partial area or thewidget of the second application displayed within the second partialarea. Further, the electronic device 2210 may receive the informationfrom the second other electronic device 6920.

In an operation 6936, the electronic device 2210 may transmitinformation on the at least one user input to the first other electronicdevice 6910. For example, the electronic device 2210 may transmit theinformation to the first other electronic device 6910 to control theexecution screen of the first application displayed within the firstpartial area or control the widget of the second application displayedwithin the first partial area, according to the at least one user inputcaused by a user of the second other electronic device 6920. Further,the first other electronic device 6910 may receive the information fromthe electronic device 2210. Based on the received information, the firstother electronic device 6910 may acquire or generate other data foreither a display state of the execution screen of the first applicationwithin the first partial area to be changed according to the at leastone user input or a display state of the widget of the secondapplication within the second partial area to be changed according tothe at least one user input.

In an operation 6938, the first other electronic device 6910 maytransmit the other data acquired based on the information to theelectronic device 2210. Further, the first other electronic device 6910may receive the other data from the electronic device 2210.

In an operation 6940, the electronic device 2210 may change the displaystate of the execution screen of the first application within the firstpartial area or change the display state of the widget of the secondapplication within the second partial area, based on the other data. Forexample, referring to FIG. 70 , the state 7010 may be switched to thestate 7020 by the changing of the display state in an operation 6940.The state 7020 may include a state 7022 of the electronic device 2210and a state 7005 of the second other electronic device 6920. In thestate 7022, the electronic device 2210 may display the execution screen7024 of the first application switched from the execution screen 2310 ofthe first application within the first partial area 2302. For example,the execution screen 7024 of the first application may be an executionscreen in which the execution screen 2310 of the first application inthe state 7012 is changed based on the at least one user input. Forexample, in the state 7005, the second other electronic device 6920 maybe in a state in which no user input is caused in relation to theelectronic device 2210.

As described above, the electronic device 2210 according to variousembodiments makes it possible to change information displayed on thedisplay 2240 of the electronic device 2210 under the control of thesecond other electronic device 6920, thereby preventing the driver ofthe vehicle with the electronic device 2210 from making any user inputfor controlling the displayed information while driving. In other words,the electronic device 2210 according to various embodiments can reducethe possibility of any unexpected traffic accident while driving thevehicle with the electronic device 2210.

FIG. 71 illustrates a flowchart for a method of the electronic devicefor controlling a display screen displayed on a display, based on a userinput received through another display according to various embodiments.This method may be executed by the infotainment device 100, the controldevice 2100 or the electronic device 2210, or may be executed by theprocessor 2230.

FIG. 72 illustrates an example of a screen on a display for changing itsdisplay state, based on a user input received through another displayaccording to various embodiments.

Referring now to FIG. 71 , in an operation 7102, the processor 2230 maydisplay an execution screen of the first application within the firstpartial area of the display, and display the first executable object anda widget of the second application within the second partial area of thedisplay.

In an operation 7104, the processor 2230 may display the executionscreen of the first application within a third partial area of anotherdisplay that is distinct from the display, and display the firstexecutable object and the widget of the second application within afourth partial area of the other display, while displaying the executionscreen of the first application within the first partial area of thedisplay and displaying the first executable object and the widget of thesecond application within the second partial area of the display. Invarious embodiments, the other display may be another display arrangedfor rear seats in the vehicle, which display is distinct from thedisplay arranged in a dashboard of the vehicle. In various embodiments,the size of the other display in the rear seats may be corresponding toor different from the size of the display in the dashboard. In variousembodiments, the aspect ratio of the other display in the rear seats maybe corresponding to or different from that of the display in thedashboard.

In various embodiments, the display area of the other display may beconfigured with a third partial area and a fourth partial area adjacentto the third partial area. In various embodiments, the arrangement ofthe third and fourth partial areas may be corresponding to thearrangement of the first partial area and the second partial area, ordifferent from the arrangement of the first partial area and secondpartial area.

For example, referring to FIG. 72 , the display and the other displaymay be in a state 7200. For example, the state 7200 may include a state2300 of the display and a state 7202 of the other display. In the state2300, the display may display the execution screen 2310 of the firstapplication within the first partial area 2302 and display the widget2312 of the second application within the second partial area 2304. Inthe state 7202, the other display may display an execution screencorresponding to the execution screen 2310 of the first applicationwithin the third partial area 7203 and a widget corresponding to thewidget 2312 of the second application within the fourth partial area7204.

In an operation 7106, the processor 2230 may receive a user input forthe third partial area or the fourth partial area while executing theoperation 7104. For example, referring to FIG. 72 , the electronicdevice 2210 may receive a user input 7205 or a user input 7220 in thestate 7200.

In an operation 7108, the processor 2230 may, in response to receivingthe user input in the operation 7106, execute a function indicated bythe user input and provide a result of execution of the function. Forexample, when the user input is related to the execution screendisplayed within the third partial area, the processor 2230 may providethe result of execution of the above function by changing the executionscreen of the first application within the first partial area and thedisplay state of the execution screen within the third partial area. Forexample, referring to FIG. 72 , the state 7200 may be switched to astate 7207 by a user input 7205. The state 7207 may include a state 7210of the display and a state 7212 of the other display. In the state 7210,the display may display an execution screen 7211 of the firstapplication within the first partial area 2302 changed according to theuser input 7205. In the state 7212, the other display may display anexecution screen 7213 within the third partial area 7203 changedaccording to the user input 7205. For another example, when the userinput is related to an execution screen displayed within the fourthpartial area, the processor 2230 may provide a result of the executionof the function by changing the widget of the second application withinthe second partial area and the display state of the widget within thefourth partial area. For example, referring to FIG. 72 , the state 7200may be switched to a state 7225 by a user input 7220. The state 7225 mayinclude a state 7227 of the display and a state 7229 of the otherdisplay. In the state 7227, the display may display a widget 7228 of thesecond application within the second partial area 2304 changed accordingto the user input 7220. In the state 7229, the other display may displaya widget 7230 within the fourth partial area 7204 changed according tothe user input 7220.

As described above, the electronic device 2210 according to variousembodiments makes it possible to change the display state of thedisplay, based on a user input to another display distinct from adisplay arranged closer to the driver's seat, so as to prevent a driverof the vehicle with the electronic device 2210 from making a user inputto control the displayed information while driving. In other words, theelectronic device 2210 according to various embodiments can prevent apossible traffic accident in driving the vehicle including theelectronic device 2210.

FIG. 73 illustrates a flowchart for a method of the electronic devicefor moving at least one executable element in an execution screen of afirst application within a first partial area or a widget of a secondapplication within a second partial area, based on a hovering inputaccording to various embodiments. This method may be executed by theinfotainment device 100, the control device 2100 or the electronicdevice 2210, or may be executed by the processor 2230.

FIG. 74 illustrates an example of at least one executable element in anexecution screen of a first application within a first partial area or awidget of a second application within a second partial area, as beingmoved according to a hovering input, according to various embodiments.

Referring to FIG. 73 , in an operation 7302, the processor 2230 maydisplay the execution screen of the first application within the firstpartial area, and display the first executable object and the widget ofthe second application within the second partial area. For example,referring to FIG. 74 , in the state 2300, the processor 2230 may displaythe execution screen 2310 of the first application within the firstpartial area 2302 and display the widget 2312 of the second applicationwithin the second partial area 2304.

In an operation 7304, the processor 2230 may identify that a hoveringinput for the display area composed of the first partial area and thesecond partial area is maintained for a predetermined time period. Invarious embodiments, the hovering input may be a hovering input causedby the user's hand spaced apart from the display area and positionedover the display area. In various embodiments, the predetermined timeperiod may be of a parameter defined to identify whether the hoveringinput is an input for moving at least one executable element in theexecution screen of the first application within the first partial areaor a widget of the second application within the second partial area. Alength of the predetermined time period may be set by the processor 2230without any user input or may be set by a user setting.

In an operation 7306, the processor 2230 may identify whether thehovering input is maintained over either the first partial area or thesecond partial area. For example, the hovering input may be maintainedfor the predetermined time period over either the first partial area orthe second partial area. When the hovering input is maintained over thefirst partial area, the processor 2230 may execute an operation 7308,and otherwise, execute an operation 7310.

In the operation 7308, the processor 2230 may move, in response toidentifying that the hovering input is maintained over the first partialarea for the predetermined time period, the at least one executableelement within the execution screen of the first application to an areain which the hovering input was received. For example, referring to FIG.74 , in response to receiving the hovering input 7400 for the firstpartial area 2302 in the state 2300, the processor 2230 may switch thestate 2300 to a state 7402. In the state 7402, the processor 2230 maymove at least one executable element 7404 in the execution screen 2310of the first application within the first partial area 2302 to the areain which the hovering input 7400 was received. Due to the movement, theuser can easily control the execution screen 2310 of the firstapplication through a user input (e.g., a touch input) following thehovering input 7400.

In an operation 7310, in response to identifying that the hovering inputis maintained for the predetermined time period over the second partialarea, the processor 2230 may move the widget of the second applicationto the area in which the hovering input was received. For example,referring to FIG. 74 , the processor 2230, in response to receiving thehovering input 7406 for the second partial area 2304 in the state 2300,may switch the state 2300 to a state 7408. In the state 7408, theprocessor 2230 may move the widget 2312 of the second application withinthe second partial area 2304 to the area where the hovering input 7406was received. Due to the movement, the user can make an easy control ofthe widget 2312 of the second application through a user input (e.g., atouch input) following the hovering input 7406.

As described above, the electronic device 2210 according to variousembodiments makes it possible to move an executable element or a widgetto a position where a hovering input was received, so that the user caneasily control the execution screen or the widget displayed on thedisplay 2240 at a desired position. Therefore, the electronic device2210 according to various embodiments can provide its user with moreenhanced user experience through such a movement.

FIG. 75 shows a flowchart for a method of the electronic device forextending at least one executable element in an execution screen of afirst application within a first partial area or a widget of a secondapplication within a second partial area, based on a hovering inputaccording to various embodiments. This method may be executed by theinfotainment device 100, the control device 2100 or the electronicdevice 2210, or may be executed by the processor 2230.

FIG. 76 illustrates an example of at least one executable element in anexecution screen of a first application in a first partial area or awidget of a second application within a second partial area, capable ofbeing extended according to a hovering input, according to variousembodiments.

Referring first to FIG. 75 , in an operation 7502, the processor 2230may display an execution screen of the first application within thefirst partial area, and display the first executable object and a widgetof the second application within the second partial area. For example,referring to FIG. 76 , in the state 2300, the processor 2230 may displaythe execution screen 2310 of the first application within the firstpartial area 2302 and display the widget 2312 of the second applicationwithin the second partial area 2304.

In an operation 7504, the processor 2230 may identify that a hoveringinput for the display area configured of the first and second partialareas is maintained for a predetermined time period. In variousembodiments, the hovering input may be a hovering input caused by theuser's hand spaced apart from the display area and positioned over thedisplay area. In various embodiments, the predetermined time period maybe a parameter defined to identify whether the hovering input is aninput for extending at least one executable element in the executionscreen of the first application within the first partial area or aninput for extending the widget of the second application within thesecond partial area. The predetermined time period may be set by theprocessor 2230 without any user input or may be set by a user setting.

In an operation 7506, the processor 2230 may identify whether thehovering input is maintained over the first partial area or over thesecond partial area. For example, the hovering input may be maintainedfor the predetermined time period over the first partial area ormaintained for the predetermined time period over the second partialarea. The processor 2230 may execute an operation 7508 when the hoveringinput is maintained over the first partial area, and otherwise, executean operation 7510.

In an operation 7508, the processor 2230 may, in response to identifyingthat the hovering input is maintained over the first partial area forthe predetermined time period, extend the at least one executableelement within the execution screen of the first application. Forexample, referring to FIG. 76 , in response to receiving a hoveringinput 7601 for the first partial area 2302 in the state 2300, theprocessor 2230 switch the state 2300 to a state 7602. In the state 7602,the processor 2230 may extend at least one executable element 7604 inthe execution screen 2310 of the first application within the firstpartial area 2302, in an area in which the hovering input 7601 wasreceived. Owing to such an extension, the user can easily control theexecution screen 2310 of the first application through a user input(e.g., a touch input) following the hovering input 7400.

In an operation 7510, in response to identifying that the hovering inputis maintained over the second partial area for the predetermined timeperiod, the processor 2230 may extend the widget of the secondapplication. For example, referring to FIG. 75 , the processor 2230, inresponse to receiving a hovering input 7605 for the second partial area2304 in the state 2300, may switch the state 2300 to a state 7606. Inthe state 7606, the processor 2230 may extend the widget 2312 of thesecond application within the second partial area 2304 in the area inwhich the hovering input 7605 was received. In various embodiments, anextended widget 2312 of the second application may be at least partiallyoverlapped on the execution screen 2310 of the first application. Thanksto such a movement, the user can easily control the widget 2312 of thesecond application through a user input (e.g., a touch input) followingthe hovering input 7605.

As described above, the electronic device 2210 according to variousembodiments can extend an executable element or a widget associated withan area where a hovering input has been received, so that the user canmake an easy control of an execution screen or a widget displayed on thedisplay 2240 at a desired location. Therefore, the electronic device2210 according to various embodiments can provide its users with moreenhanced user experience through such an extension of the executableelement or the widget.

FIG. 77 illustrates a flowchart for a method of the electronic devicefor adaptively controlling event information to be displayed in anexecution screen of a first application displayed within a first partialarea, based on an eye gaze input, according to various embodiments. Thismethod may be executed by the infotainment device 100, the controldevice 2100 or the electronic device 2210, or may be executed by theprocessor 2230.

FIG. 78 illustrates an example of event information in an executionscreen of a first application within a first partial area that isadaptively displayed, based on an eye gaze input, according to variousembodiments.

Referring now to FIG. 77 , in an operation 7702, the processor 2230 maydisplay an execution screen of the first application within the firstpartial area. For example, referring then to FIG. 78 , in a state 7800,the processor 2230 may display an execution screen 2310 of the firstapplication within the first partial area 2302. In various embodiments,the processor 2230 may display a widget of the second application withinthe second partial area, while displaying the execution screen of thefirst application within the first partial area.

In an operation 7704, the processor 2230 may monitor or identify whetherit is identified the eye gaze input looking at the display area or anexecution screen of the first application within the first partial areafor a predetermined time period displays, while displaying the executionscreen of the first application within the first partial area. Invarious embodiments, the eye gaze input may be identified based on animage captured through the camera 2247. For example, referring to FIG.78 , in a state 7800, the processor 2230 may monitor or identify whetherit is identified the eye gaze input caused by a state 7830, whiledisplaying the execution screen 2310 of the first application within thefirst partial area 2302. In various embodiments, while displaying theexecution screen of the first application within the first partial area,the processor 2230 may execute an operation 7708 based on monitoring theidentification of the eye gaze input, and otherwise, execute anoperation 7706.

Although FIGS. 77 and 78 illustrate an example of monitoring whether theprocessor 2230 identifies the eye gaze input while displaying theexecution screen of the first application within the first partial area,it is only for convenience of the description and the eye gaze input maybe replaced with another user input. For example, the other user inputmay be made up with a certain user action caused by the user payingattention to the execution screen of the first application. For example,the user action may be at least one of a change in weight of a driver'sseat of the vehicle caused by the user paying attention to the executionscreen of the first application or a change in tension of a seat beltworn by the user sitting in the driver's seat, although it is notlimited thereto. For example, when the eye gaze input is replaced withthe other user input, the processor 2230 may then execute, based onmonitoring identifying the other user input, an operation 7708, andotherwise, execute an operation 7706.

Although FIGS. 77 and 78 illustrate an example of monitoring whether ornot the processor 2230 identifies the eye gaze input while displayingthe execution screen of the first application within the first partialarea, it is only for convenience of the explanation. The monitoringwhether to identify the eye gaze input may be replaced with monitoringwhether the frequency at which the eye gaze inputs occur is greater thanor equal to a reference number. For example, the frequency at which theeye gaze inputs occur may mean the number of occurrences of the eye gazeinputs for a given unit time. Then, based on monitoring that thefrequency of the eye gaze inputs is equal to or greater than thereference number, the processor 2230 may execute the operation 7708, andotherwise, execute the operation 7706.

In an operation 7706, the processor 2230 may display event informationwithin the execution screen of the first application on basis of apredetermined timing or period, based on monitoring that the eye gazeinput is not identified while displaying the execution screen of thefirst application within the first partial area. In various embodiments,the event information may be displayed to provide new information orprovide other information that is distinct from the informationcurrently being provided. For example, if the first application is anapplication for providing a navigation service, then the eventinformation may include information on a routing direction of thevehicle displayed in the execution screen of the first applicationbefore the vehicle including the electronic device 2210 enters an arealocated within a predetermined distance from a junction or intersection.For another example, if the first application is an application forproviding the navigation service, then the event information may furtherinclude information on the lane to change in order for the driver todrive the vehicle according to the route guided by the firstapplication. For another example, if the first application is anapplication for providing the navigation service, then the eventinformation may further include route guidance information to bedisplayed before the vehicle enters an underground lane. However, it isnot limited thereto.

In various embodiments, the predetermined timing may be a timing todisplay the event information, when the eye gaze input is not identifiedin the operation 7704. For example, the predetermined timing may be atiming when the distance from the vehicle including the electronicdevice 2210 to a place associated with the event information reaches apredetermined distance. For example, if the event information isinformation on a direction to drive the vehicle at a junction and thepredetermined distance is 100 m, then the processor 2230 may display theevent information on the execution screen of the first application,based on identifying that the distance between the vehicle and thejunction is at 100 m. For another example, the predetermined timing maybe a timing in advance of a predetermined time interval from a timingpoint when the vehicle is expected to enter a place related to the eventinformation. For example, if the event information is of route guidanceinformation displayed before the vehicle enters an underground lane, thetime when the vehicle is expected to enter the underground lane is 1minute after the current time, and the predetermined time internal is 10seconds, then the processor 2230 may display the event informationwithin the execution screen of the first application, 50 seconds afterthe current time. However, it is not limited thereto.

For example, referring then to FIG. 78 , the processor 2230 may switch,in response to monitoring in state 7800 that it is not identified theeye gaze input caused by the state 7830, the state 7800 to a state 7805.In the state 7805, the processor 2230 may display event information 7810on the execution screen 2310 of the first application within the firstpartial area 2302, based on the predetermined timing. For example, inthe state 7805, the predetermined timing may be a timing point 7815 toidentify that the distance between the electronic device 2210 and theplace (e.g., a junction) related to the event information 7810 is 150 m.As another example, in the state 7805, the predetermined timing may be atiming point 7820 at which N seconds has elapsed from the state 7800,wherein N is a real number exceeding zero. However, it is not limitedthereto.

In various embodiments, the predetermined period may be a period inwhich the event information is displayed when the eye gaze input is notidentified in the operation 7704. For example, if the predeterminedperiod is 10 seconds, the processor 2230 may display the eventinformation every 10 seconds in response to monitoring that it is notidentified the eye gaze input in an operation 7704. However, it is notlimited thereto.

In an operation 7708, the processor 2230 may display the eventinformation within the execution screen of the first application on thebasis of another predetermined timing distinguished from thepredetermined timing or another predetermined period distinguished fromthe predetermined period, based on monitoring that the eye gaze input isidentified while displaying the execution screen of the firstapplication within the first partial area.

In various embodiments, the other predetermined timing may be set to befaster than the predetermined timing. For example, the otherpredetermined timing may be a timing point at which the distance fromthe vehicle including and the electronic device 2210 to the placerelated to the event information gets to another predetermined distancedistinguished from the predetermined distance in the operation 7706. Forexample, if the event information is of information on a routingdirection of the vehicle at an approaching junction and thepredetermined distance is 100 m, then the other predetermined distancemay be 300 m. For example, as opposed to the operation 7706, theprocessor 2230 may display the event information within the executionscreen of the first application, based on identifying that the distancefrom the vehicle and the junction is 300 m. For another example, thepredetermined timing point may be a timing point prior to apredetermined time, which is distinguished from a timing point at whichthe vehicle is expected to enter the place related to the eventinformation. For example, if the event information is information forroute guidance displayed before the vehicle enters the underground lane,the time at which the vehicle is expected to enter the underground laneis 1 minute after the current time, and the predetermined time is 10seconds, then the other predetermined time may be 20 seconds. Forexample, the processor 2230 may display the event information in theexecution screen of the first application 40 seconds after the currenttime. However, it is not limited thereto.

For example, referring to FIG. 78 , in response to monitoringidentifying the eye gaze input caused by the state 7830, in the state7800, the processor 2230 may switch the state 7800 to a state 7850. Inthe state 7850, the processor 2230 may display, based on the otherpredetermined timing, the event information 7860 in the execution screen2310 of the first application within the first partial area 2302. Forexample, in the state 7850, the other predetermined timing may be atiming point 7865 of identifying that the distance from the electronicdevice 2210 to the place (e.g., a junction) associated with the eventinformation 7860 is 500 m. For another example, in the state 7850, theother predetermined timing is a timing point at which N-M seconds haselapsed from the state 7800, wherein M is a real number exceeding zeroand less than and equal to N, although it is not limited thereto.

In various embodiments, the other predetermined period may be a periodin which the event information is displayed when the eye gaze input isidentified in the operation 7704. The other predetermined period may beset shorter than the predetermined period. For example, the otherpredetermined period may be 5 seconds shorter than 10 seconds of thepredetermined period. For example, if the other predetermined period is5 seconds, the processor 2230 may display the event information every 5seconds in response to monitoring that the eye gaze input is identifiedin the operation 7704, although it is not limited thereto.

In various embodiments, at least one of the other predetermined timingor the other predetermined period may be set by a user input or by theprocessor 2230 without any user input.

FIGS. 77 and 78 illustrate an example of displaying the eventinformation through the display 2240 of the electronic device 2210, butthe event information may be provided in various formats in relation tothe electronic device 2210. For example, the event information may beprovided through an audio signal, although not limited thereto.

Further, in various embodiments, the processor 2230 may further executenot only the operation 7708 but also other operations, while identifyingthe eye gaze input. For example, the processor may increase theoperating frequency of the sensor 2249 of the electronic device 2210,independently of executing the operation 7708, while identifying the eyegaze input or receiving the eye gaze input. For example, such anoperation of causing the user of the electronic device 2210 to make aneye gaze input may imply that the user is not looking ahead whiledriving the vehicle with the electronic device 2210. In order to preventa traffic accident against the vehicle with the electronic device 2210from occurring due to causing the driver to make the eye gaze input, theprocessor 2230 may increase the operating frequency of the sensor 2249while identifying the eye gaze input. Through such an increase in theoperating frequency of the sensor 2249, the processor 2230 can moreaccurately identify the condition of the environment around the vehicleincluding the electronic device 2210, while identifying the eye gazeinput. Further, the processor 2230 can restore the original operatingfrequency of the sensor 2249 based on identifying the completion of theeye gaze input.

As described above, the electronic device 2210 according to variousembodiments makes it possible to adaptively control the timing or periodof providing the event information according to whether the eye gazeinput is identified, thereby leading to more enhanced user experience.

FIG. 79 illustrates a flowchart for an operating method of theelectronic device for controlling event information to be displayed inan execution screen of an application within a first partial area,depending on whether a destination for route guidance was initially set,according to various embodiments. This method may be executed by theinfotainment device 100, the control device 2100 or the electronicdevice 2210, or may be executed by the processor 2230.

Referring to FIG. 79 , in an operation 7902, the processor 2230 maydisplay an execution screen of the first application within the firstpartial area. For example, the operation 7902 may correspond to theoperation 7702.

In an operation 7904, the processor 2230 may receive a user input forsetting a destination, while displaying the execution screen of thefirst application within the first partial area. In various embodiments,if the first application is an application for providing a navigationservice, the destination may indicate a place where the vehicle with theelectronic device 2210 is to travel to. In various embodiments, the userinput may be received through at least one executable element in theexecution screen of the first application within the first partial area.In various embodiments, the user input may be received through an audiosignal. However, it is not limited thereto.

In an operation 7906, in response to receiving the user input in anoperation 7904, the processor 2230 may identify whether the setdestination is a destination initially set in the electronic device2210. For example, the processor 2230 may store history information ofdestinations input to the electronic device 2210 for the route guidanceof the vehicle. The processor 2230 may identify whether the destinationset by the user input in the operation 7904 is the first destination,based on the history information. If the set destination is thedestination initially set, the processor 2230 may execute the operation7708, and otherwise, execute the operation 7706.

In an operation 7908, the processor 2230 may display, in response toidentifying that the set destination is not the first set destination,the event information in the execution screen of the first application,based on a predetermined timing or period. For example, the eventinformation may be event information defined through the description ofFIGS. 77 and 78 . For example, the predetermined timing may be apredetermined timing defined through the description of FIGS. 77 and 78. For example, the predetermined period may be a predetermined perioddefined through the description of FIGS. 77 and 78 .

In an operation 7910, the processor 2230 may display, in response toidentifying that the set destination is the first set destination, theevent information in the execution screen of the first application,based on either another predetermined timing distinguished from thepredetermined timing or another predetermined period distinguished fromthe predetermined period. For example, the event information may beevent information defined through the description of FIGS. 77 and 78.For example, the other predetermined timing may be another predeterminedtiming defined through the description of FIGS. 77 and 78 . For example,the other predetermined period may be another predetermined perioddefined through the description of FIGS. 77 and 78 .

Although not shown in FIG. 79 , the processor 2230 may change the timingor period to display the event information, according to the frequencyof setting the destination for the route guidance. For example, if thedestination is a first destination A where the user inputs at least oncea day, then the processor 2230 may set the length of a frequency periodto display the event information to X, and if the destination is asecond destination B where the user inputs at least once a month, thenthe processor 2230 may set the length of a frequency period to displaythe event information to Y, which is shorter than the length X. However,it is not limited thereto.

As described above, the electronic device 2210 according to variousembodiments makes it possible to adaptively change the timing ofproviding the event information or the frequency period of providing theevent information, according to whether such an initially setdestination is input, thereby providing its user with more enhanced userexperience.

The device or apparatus described above may be implemented as a hardwarecomponent, a software component, and/or a combination of a hardwarecomponent and a software component. For example, the devices andcomponents described in the various embodiments may be implemented usingone or more general-purpose or specific-purpose computers, such as forexample, a processor, a controller, an arithmetic logic unit (ALU), adigital signal processor, a microcomputer, a field programmable gatearray (FPGA), a programmable logic unit (PLU), a microprocessor, or anyother device capable of executing and responding to instructions. Aprocessing device may execute an operating system (OS) and one or moresoftware applications executed on the basis of the operating system.Further, the processing device may access, store, manipulate, process,and generate data in response to the execution of the software. For theconvenience of understanding, although it is described in variousembodiments that a single processing device is used, an expert skilledin the art will appreciate that such a processing device may be of aplurality of processing elements and/or multiple types of processingelements. For example, the processing device may include a plurality ofprocessors or one processor and one controller. Further, it would bepossible to use other processing configurations such as e.g., a parallelprocessor.

The software may include at least one computer program, code,instruction, or a combination of one or more of them, and configure theprocessing unit to operate as required, or independently or collectivelyinstruct the processing unit. Software and/or data may be embodied inany type of machine, component, physical device, computer storage mediumor device to be interpreted by the processing unit or to provideinstructions or data to the processing unit. The software may bedistributed over networked computer systems and stored or executed in adistributed manner. The software and data may be stored into one or morecomputer-readable recording media.

The method according to the various embodiments may be implemented in aform of program instructions that can be executed through variouscomputer means, and recorded in a computer-readable medium. Further, themedium may be one that continuously stores a program executable by acomputer, or temporarily stores a program for execution or download.Further, the medium may be a variety of recording means or storage meansin a form combined of a single or multiple pieces of hardware, but it isnot limited to a medium directly connected to a computer system and mayexist distributed over networks. Examples of media may include magneticmedia such as e.g., hard disks, floppy disks, and magnetic tapes;optical recording media such as e.g., CD-ROMs and DVDs; magneto-opticalmedia such as e.g., floptical disks; ROM, RAM, flash memory, and anyother recording media configured to store program instructions. Further,examples of other media may include an app store distributingapplications, a website supplying or distributing various software, anda recording medium or a storage medium managed by a server.

As described above, the embodiments have been described by means ofthose exemplary embodiments and drawings, but an expert skilled in theart could make various modifications and variations from the abovedescription. For example, the described techniques may be performed in adifferent order from that of the described method, and/or those elementsof the described system, structure, device, circuit, or the like may becoupled or combined in a form that is different from the describedmethod, or may be substituted by other components or their equivalents,so as to achieve the substantially same result.

Therefore, other implementations, other embodiments and theirequivalents will also fall within the scope of the claims to bedescribed later.

What is claimed is:
 1. A non-transitory computer readable storage mediumstoring at least one program, the at least one program comprisinginstructions to, when executed by at least one processor of anelectronic device included within a vehicle and including a display,cause the electronic device to: while executing a first application anda second application, display an execution screen of the firstapplication within a first partial area, and display a widget of thesecond application including a first executable element and a secondexecutable element, and a first executable object to indicate the firstapplication, within a second partial area located adjacent to the firstpartial area, the first partial area and the second partial area forminga display area of the display; based on receiving a first user input forthe first executable element of the widget of the second applicationwhile displaying the execution screen of the first application withinthe first partial area and displaying the widget of the secondapplication and the first executable object within the second partialarea, display an execution screen of the second application switchedfrom the execution screen of the first application within the firstpartial area and display within the second partial area a widget of thefirst application switched from the first executable object and thesecond executable element to indicate the second application, beingswitched from the widget of the second application; and based onreceiving a second user input for the second executable element of thewidget of the second application while displaying the execution screenof the first application within the first partial area and displayingthe widget of the second application and the first executable objectwithin the second partial area, display at least one visual itemavailable through the second executable element within an area extendingfrom the widget of the second application, in an overlapping manner, onthe execution screen of the first application displayed within the firstpartial area.
 2. The non-transitory computer readable storage mediumaccording to claim 1, wherein the at least one program comprisesinstructions to, when executed by the at least one processor of theelectronic device, cause the electronic device to: display the executionscreen of the first application within the first partial area anddisplay the widget of the second application and the first executableobject within the second partial area, with no user input beingreceived, while executing the first application and the secondapplication.
 3. The non-transitory computer readable storage mediumaccording to claim 1, wherein: the first user input is a single tapinput for the first executable element; the second user input is asingle tap input for the second executable element; and the at least oneprogram comprises instructions to, when executed by the at least oneprocessor of the electronic device, further cause the electronic deviceto: based on receiving a third user input dragging the widget of thesecond application in a first direction, while displaying the executionscreen of the first application within the first partial area anddisplaying the widget of the second application and the first executableobject within the second partial area, display an extended widget of thesecond application switched from the widget of the second applicationwithin the second partial area; and based on receiving a fourth userinput dragging the widget of the first application in the firstdirection, while displaying the execution screen of the secondapplication within the first partial area and displaying the widget ofthe first application and the second executable object within the secondpartial area, display an extended widget of the first applicationswitched from the widget of the first application within the secondpartial area; wherein the display position of the first executableobject is moved in the first direction according to switching from thewidget of the second application to the extended widget of the secondapplication, when the widget of the second application is switched tothe extended widget of the second application through the third userinput, while the direction from the widget of the second application tothe first executable object is the first direction, and the displayposition of the first executable object is maintained independently ofswitching from the widget of the second application to the extendedwidget of the second application, when the widget of the secondapplication is switched to the extended widget of the second applicationthrough the third user input, while the direction from the widget of thesecond application to the first executable object is a second directionopposite to the first direction; wherein the display position of thesecond executable object is moved in the first direction according toswitching from the widget of the first application to the extendedwidget of the first application, when the widget of the firstapplication is switched to the extended widget of the first applicationthrough the fourth user input, while the direction from the widget ofthe first application to the second executable object is the firstdirection, and the display position of the second executable object ismaintained independently of switching from the widget of the firstapplication to the extended widget of the first application, when thewidget of the first application is switched to the extended widget ofthe first application through the fourth user input, while the directionfrom the widget of the first application to the second executable objectis the second direction.
 4. The non-transitory computer readable storagemedium according to claim 1, wherein: the widget of the secondapplication and the first executable object are displayed within thesecond partial area together with a third executable object to indicatea third application; and the at least one program comprises instructionsto, when executed by the at least one processor of the electronicdevice, further cause the electronic device to: based on receiving athird user input dragging the third executable object in the firstdirection, while displaying the execution screen of the firstapplication within the first partial area and displaying the widget ofthe second application and the first executable object together with thethird executable object within the second partial area, maintaindisplaying of the execution screen of the first application within thefirst partial area, execute the third application; and display a widgetof the third application switched from the third executable objecttogether with the widget of the second application and the firstexecutable object within the second partial area.
 5. The non-transitorycomputer readable storage medium according to claim 1, wherein the atleast one program comprises instructions to, when executed by the atleast one processor of the electronic device, further cause theelectronic device to: based on receiving a third user input for anotherarea within the second partial area distinguished from the display areaof the widget of the second application and the display area of thefirst executable object, display a third executable object to indicate afunction distinguished from the functions available through the firstapplication and the second application within the second partial area,together with the widget of the second application and the firstexecutable object; and based on receiving a fourth user input for thethird executable object, execute the function indicated by the thirdexecutable object.
 6. The non-transitory computer readable storagemedium according to claim 5, wherein the at least one program comprisesinstructions to, when executed by the at least one processor of theelectronic device, further cause the electronic device to switch theexecution screen of the first application displayed within the firstpartial area to the execution screen of the function, in response toexecution of the function indicated by the third executable object. 7.The non-transitory computer readable storage medium according to claim5, wherein the at least one program comprises instructions to, whenexecuted by the at least one processor of the electronic device, furthercause the electronic device to switch the third executable objectdisplayed within the second partial area to a widget for indicating anexecution state of the function, in response to execution of thefunction indicated by the third executable object.
 8. The non-transitorycomputer readable storage medium according to claim 5, wherein thefunction is a function that has been most recently provided through theelectronic device among a plurality of functions that are available withthe electronic device and distinguished from the functions availablethrough the first application and the second application.
 9. Thenon-transitory computer readable storage medium according to claim 5,wherein the function is a function that has been most frequentlyprovided through the electronic device among a plurality of functionsthat are available with the electronic device and distinguished from thefunctions available through the first application and the secondapplication.
 10. The non-transitory computer readable storage mediumaccording to claim 5, wherein the at least one program comprisesinstructions to, when executed by the at least one processor of theelectronic device, further cause the electronic device to: switch thethird executable object to a fourth executable object to indicateanother function distinct from the functions available through the firstapplication and the second application, based on receiving a fifth userinput for the third executable object; and execute the other functionindicated by the fourth executable object, based on receiving a sixthuser input for the fourth executable object; wherein the fourth userinput is a single tap input to the third executable object, and thefifth user input is an input to drag the third executable object in adesignated direction.
 11. The non-transitory computer readable storagemedium according to claim 5, wherein the at least one program comprisesinstructions to, when executed by the at least one processor of theelectronic device, further cause the electronic device to: execute thefunction of the first application indicated by a fifth user input, basedon receiving the fifth user input for the other area within the secondpartial area distinguished from the display area of the widget of thesecond application and the display area of the first executable object;and change the state of the execution screen of the first applicationdisplayed within the first partial area, based on the execution of thefunction of the first application; wherein the attribute of the fifthuser input is distinguished from the attribute of the third user input.12. The non-transitory computer readable storage medium according toclaim 5, wherein the at least one program comprises instructions to,when executed by the at least one processor of the electronic device,further cause the electronic device to: execute the function of thesecond application indicated by a fifth user input, based on receivingthe fifth user input for the other area within the second partial areadistinguished from the display area of the widget of the secondapplication and the display area of the first executable object; andchange the state of the widget of the second application displayedwithin the second partial area, based on the execution of the functionof the second application.
 13. The non-transitory computer readablestorage medium according to claim 5, wherein the at least one programcomprises instructions to, when executed by the at least one processorof the electronic device, further cause the electronic device to:display a handwriting input field in an overlapping manner, on theexecution screen of the first application displayed within the firstpartial area, based on receiving a fifth user input for the other areawithin the second partial area distinguished from the display area ofthe widget of the second application and the display area of the firstexecutable object; and recognize a character indicated by a path of atleast one drag input, based on receiving the at least one drag inputinitiated from the handwriting input field; wherein the attribute of thefifth user input is distinct from the attribute of the third user input.14. The non-transitory computer readable storage medium according toclaim 13, wherein the handwriting input field is extended from at leasta part of the other area within the second partial area, and a part ofthe execution screen of the first application disposed underneath thehandwriting input field is translucent so that it is visible.
 15. Thenon-transitory computer readable storage medium according to claim 13,wherein the at least one program comprises instructions to, whenexecuted by the at least one processor of the electronic device, furthercause the electronic device to: based on the fifth user input, display aplurality of executable objects for respectively indicating a pluralityof applications including the first application and the secondapplication, in an overlapping manner on the execution screen of thefirst application displayed within the first partial area, together withthe handwriting input field; recognize the character indicated by thepath of the at least one drag input, based on receiving the at least onedrag input initiated from the handwriting input field after receiving asixth user input to select an executable object among the plurality ofexecutable objects; and execute an application indicated by theexecutable object selected by the sixth user input and a functioncorresponding to the recognized character.
 16. The non-transitorycomputer readable storage medium according to claim 13, wherein the atleast one program comprises instructions to, when executed by the atleast one processor of the electronic device, further cause theelectronic device to recognize the path of the at least one drag inputpassing by a part of the execution screen of the first applicationbeyond the handwriting input field, as a part of the character insteadof the user input for the first application, while the at least one draginput initiated from the handwriting input field is received.
 17. Thenon-transitory computer readable storage medium according to claim 16,wherein the at least one program comprises instructions to, whenexecuted by the at least one processor of the electronic device, furthercause the electronic device to display a part of the path of the atleast one drag input on the execution screen of the first applicationdisplayed within the first partial area.
 18. The non-transitory computerreadable storage medium according to claim 1, wherein the at least oneprogram comprises instructions to, when executed by the at least oneprocessor of the electronic device, further cause the electronic deviceto: display a third executable object for guiding a recommended functionwithin another area of the second partial area distinguished from thedisplay area of the widget of the second application and the displayarea of the first executable object, while displaying the executionscreen of the first application within the first partial area anddisplaying the widget of the second application and the first executionwithin the second partial area; and execute the recommended function,based on receiving a third user input for the third executable object,while displaying the execution screen of the first application withinthe first partial area and displaying the third executable objecttogether with the widget of the second application and the firstexecutable object within the second partial area; wherein therecommended function is identified from a model that is related to theelectronic device and configured to predict a future execution patternof the electronic device, based on past execution heuristics including apast execution history of the electronic device.
 19. An electronicdevice included within a vehicle, the electronic device comprising: adisplay; a memory configured to store instructions; and at least oneprocessor, the at least one processor, when executing the instructions,being configured to: while executing a first application and a secondapplication, display an execution screen of the first application withina first partial area, and display a widget of the second applicationincluding a first executable element and a second executable element,and a first executable object to indicate the first application, withina second partial area located adjacent to the first partial area, thefirst partial area and the second partial area forming a display area ofthe display; based on receiving a first user input for the firstexecutable element of the widget of the second application whiledisplaying the execution screen of the first application within thefirst partial area and displaying the widget of the second applicationand the first executable object within the second partial area, displayan execution screen of the second application switched from theexecution screen of the first application within the first partial area,and display within the second partial area a widget of the firstapplication switched from the first executable object and the secondexecutable element to indicate the second application, being switchedfrom the widget of the second application; and based on receiving asecond user input for the second executable element of the widget of thesecond application while displaying the execution screen of the firstapplication within the first partial area and displaying the widget ofthe second application and the first executable object within the secondpartial area, display at least one visual item available through thesecond executable element within an area extending from the widget ofthe second application, in an overlapping manner, on the executionscreen of the first application displayed within the first partial area.20. A method for operating an electronic device included within avehicle and having a display, the method comprising: while executing afirst application and a second application, displaying an executionscreen of the first application within a first partial area, anddisplaying a widget of the second application including a firstexecutable element and a second executable element, and a firstexecutable object to indicate the first application, within a secondpartial area located adjacent to the first partial area, the firstpartial area and the second partial area forming a display area of thedisplay; based on receiving a first user input for the first executableelement of the widget of the second application while displaying theexecution screen of the first application within the first partial areaand displaying the widget of the second application and the firstexecutable object within the second partial area, displaying anexecution screen of the second application switched from the executionscreen of the first application within the first partial area anddisplaying within the second partial area a widget of the firstapplication switched from the first executable object and the secondexecutable element to indicate the second application, being switchedfrom the widget of the second application; and based on receiving asecond user input for the second executable element of the widget of thesecond application while displaying the execution screen of the firstapplication within the first partial area and displaying the widget ofthe second application and the first executable object within the secondpartial area, displaying at least one visual item available through thesecond executable element within an area extending from the widget ofthe second application, in an overlapping manner, on the executionscreen of the first application displayed within the first partial area.